NON-PARAMETRIC METHOD FOR DETECTING BREAKDOWN OF TIME SERIES USING THE RANDOM WALKS THEORY MECHANISM
Abstract
The task of the on-line detection of a sudden change in the probability properties of a time series is considered, which is usually interpreted as the detecting task of change point the characteristics (breakdown) in the observed stochastic process. The actuality of the development of research on this topic is noted, which is due to the emergence of ever new applied problems where methods and algorithms for breakdown detecting can be successfully used - in particular, when creating monitoring systems in industry, ecology, medicine, etc. Two main varieties of methods for breakdown detecting are discussed: parametric and nonparametric. It is noted that, although nonparametric methods, ceteris paribus, are inferior to parametric methods in terms of efficiency (the speed of breakdown detecting), they also have a number of advantages, without requiring, in particular, for their application detailed information about the probabilistic properties of the controlled process. This is fundamentally important for building monitoring systems, when detailed information about these properties may either be completely absent and then it is necessary to conduct a rather laborious preliminary study of it, or to be unreliable. An original sequential nonparametric algorithm for detecting discord is proposed based on the implementation of the random walk mechanism or, more specifically, using the theory of success runs. The operating principle of the control algorithm is explained and its description is given. The results of the study of the basic statistical characteristics of the algorithm, including the determination of its effectiveness, and results of comparison with known parametric methods, are given. The area of possible practical use of the proposed algorithm is highlighted, where its effectiveness remains quite high. The prospects of using the proposed algorithm as part of the software and algorithmic support of monitoring systems for various purposes are noted.
References
detection of changes in the properties of time series]. Moscow: Nauka, 1983, 200 p.
2. GOST R. ISO 7870-2-2015 Natsional'nyy standart Rossiyskoy Federatsii. Statisticheskie
metody. Kontrol'nye karty [GOST R ISO 7870-2-2015 national standard of the Russian Federation.
Statistical technology. Control card]. Standartinform, 2016.
3. Page E.S. Continuous inspection schemes, Biometrika, 1954, Vol. 41, No. 1, pp. 100-115.
4. Lorden G. Procedures for Reacting to a Change in Distribution, Annalsof Mathematical Statistics,
1971, Vol. 42,6, pp. 1897-1908.
5. Shafid Ahmad. Bibliometric Analysis of EWMA and CUSUM Control Chart Schemes, ITEE
Journal, April 2018, Vol. 7, Issue 2, pp. 1-11.
6. Shiryaev A.N. Zadacha skoreyshego obnaruzheniya narusheniya statsionarnogo rezhima [The
problem of early detection of violations of the stationary regime], Doklady AN SSSR [Doklady
Akademii Nauk USSR], 1961, Vol. 138, No. 5, pp. 1039-1042.
7. Chakraborti S., Laan van der P., Bakir S.T. Nonparametric Statistical Process Control: An
Overview and Some Results. (Memorandum COSOR; Vol.9908). Eindhoven: Technische
Universiteit Eindhoven, 1999.
8. Chakraborti S., Van der Laan P, & Bakir S.T. Nonparametric statistical process control: an
overview and some results, Journal of quality technology, 2001, Vol. 33 (3), pp. 304-315.
9. Saad Bakir. Classification distribution-free quality control charts, Proceedings of the Annual
Meeting of the American Statistical Association, August 5-9, 2001, 15 p.
10. Chakraborti S., Graham M.A. Nonparametric Statistical Process Control. John Wiley & Sons
Ltd, 2019, 429 p.
11. Bakir S.T. and Reynolds Jr. M.R. A nonparametric procedure for process control based on
within-group ranking, Technometrics, 1979, No. 21 (2), pp. 175-183.
12. Amin R.W., Reynolds Jr. M.R., and Bakir S.T. Nonparametric quality control charts based on
the sign statistic, Communications in Statistics: Theory and Methods, 1995, No. 24 (6),
pp. 1597-1623.
13. Janacek G.J. and Meikle S.E. Control charts based on medians, The Statistician, 1997, Vol. 46
(1), pp. 19-31.
14. McDonald D. A CUSUM procedure based on sequential ranks, Naval Research logistics,
1999, Vol. 37, pp. 627-646.
15. Bakir S.T. A distribution-free Shewhart quality control chart based on signed-ranks, Quality
Engineering, 2004, No. 16 (4), pp. 613-623.
16. Chakraborti S. and Van de Wiel M.A. A nonparametric control chart based on the Mann–
Whitney statistic. IMS Collections, Beyond Parametrics in Interdisciplinary Research: Festschrift
in Honor of Professor Pranab K. Sen, 2008, No. 1, pp. 156-172.
17. Human S.W., Chakraborti S., and Smit C.F. Nonparametric Shewhart-type sign control charts
based on runs, Communications in Statistics: Theory and Methods, 2010b, Vol. 39 (11),
pp. 2046-2062.
18. Zhou Chunguang, Zou Changliang, Zhang Yujuan, Wang Zhaojun. Nonparametric control
charts based on change-point model. Statistical Papers, 2009, Vol. 50, pp. 13-28.
19. Feller U. Vvedenie v teoriyu veroyatnostey i ee prilozheniya [Introduction to probability
theory and its applications]. Vol. 1. Moscow: Izd-vo «Mir», 1970, 499 p.
20. Mc. Gilchrist C.A., Woodyer K.D. Note on a distribution-free CUSUM technique,
Technometrics, 1975, Vol. 17, No. 3, pp. 321-325.