A Novel Weak Estimator For Dynamic Systems

In this paper, we propose a novel approach for classifying incoming continuous data under a non-stationary environment. A class of estimators termed stochastic learning weak estimators has been generalized to include continuous time sampling and countable state categories. The method is founded on non-stationary Markov chain techniques and is useful in diverse applications, such as consumer behavior analysis, e-mail spam classification, or understanding drug effectiveness. In terms of tracking the true state probabilities, these weak estimators consistently outperform traditional competitors such as maximum likelihood estimates. Only one user defined parameter is necessary and the method is free of subjective “moving window” type algorithms. We have conducted extensive simulations and real data analyses for classification purposes.

[1]  Moinak Bhaduri,et al.  A Quantitative Insight into the Dependence Dynamics of the Kilauea and Mauna Loa Volcanoes, Hawaii , 2017, Mathematical Geosciences.

[2]  Moinak Bhaduri,et al.  On a novel approach to forecast sparse rare events: applications to Parkfield earthquake prediction , 2015, Natural Hazards.

[3]  Boualem Boashash,et al.  Methods of signal classification using the images produced by the Wigner-Ville distribution , 1991, Pattern Recognit. Lett..

[4]  L. Breuer Introduction to Stochastic Processes , 2022, Statistical Methods for Climate Scientists.

[5]  A Min Tjoa,et al.  Performance Comparison between Naïve Bayes, Decision Tree and k-Nearest Neighbor in Searching Alternative Design in an Energy Simulation Tool , 2013 .

[6]  C. Doncarli,et al.  Improved optimization of time-frequency-based signal classifiers , 2001, IEEE Signal Processing Letters.

[7]  Asit P. Basu,et al.  Statistical Methods for the Reliability of Repairable Systems , 2000 .

[8]  R. Tweedie Sufficient conditions for ergodicity and recurrence of Markov chains on a general state space , 1975 .

[9]  Luis Rueda,et al.  Toward New Paradigms to Combating Internet Child Pornography , 2006, 2006 Canadian Conference on Electrical and Computer Engineering.

[10]  Sarajane Marques Peres,et al.  Gesture unit segmentation using support vector machines: segmenting gestures from rest positions , 2013, SAC '13.

[11]  J. Rosenthal,et al.  General state space Markov chains and MCMC algorithms , 2004, math/0404033.

[12]  L. J. Bain,et al.  Inferences on the Parameters and Current System Reliability for a Time Truncated Weibull Process , 1980 .

[13]  Benjamin Lipstein A Mathematical Model of Consumer Behavior , 1965 .

[14]  Lee J. Bain Statistical analysis of reliability and life-testing models : theory and methods , 1992 .

[15]  W. Marsden I and J , 2012 .

[16]  D. Vere-Jones Markov Chains , 1972, Nature.

[17]  Sheldon M. Ross,et al.  Stochastic Processes , 2018, Gauge Integral Structures for Stochastic Calculus and Quantum Electrodynamics.

[18]  Siqi Tan A statistical model for long-term forecasting of strong sand dust storms , 2014 .

[19]  2013 , 2018, Eu minha tía e o golpe do atraso.

[20]  Jean Thomas Johnson,et al.  Ergodic properties of nonhomogeneous, continuous-time Markov chains , 1984 .

[21]  Jasha Droppo,et al.  Optimizing time-frequency distributions for automatic classification , 1997, Optics & Photonics.

[22]  B. John Oommen,et al.  Anomaly Detection in Dynamic Systems Using Weak Estimators , 2011, TOIT.

[23]  C. Watkins Learning from delayed rewards , 1989 .

[24]  M. S. Bartlett,et al.  On the differential equations for the transition probabilities of Markov processes with enumerably many states , 1953, Mathematical Proceedings of the Cambridge Philosophical Society.

[25]  B. John Oommen,et al.  Stochastic learning-based weak estimation of multinomial random variables and its applications to pattern recognition in non-stationary environments , 2006, Pattern Recognit..

[26]  Lee J. Bain,et al.  Tests for an Increasing Trend in the Intensity of a Poisson Process: A Power Study , 1985 .

[27]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[28]  P. A. Franklin,et al.  Effect of substantial gainful activity level on disabled beneficiary work patterns. , 1979, Social security bulletin.

[29]  George Forman,et al.  Learning from Little: Comparison of Classifiers Given Little Training , 2004, PKDD.

[30]  Vijay D. Katkar,et al.  A novel parallel implementation of Naive Bayesian classifier for Big Data , 2013, 2013 International Conference on Green Computing, Communication and Conservation of Energy (ICGCE).

[31]  Harry Zhang,et al.  Exploring Conditions For The Optimality Of Naïve Bayes , 2005, Int. J. Pattern Recognit. Artif. Intell..

[32]  B. John Oommen,et al.  A Fault-Tolerant Routing Algorithm for Mobile Ad Hoc Networks Using a Stochastic Learning-Based Weak Estimation Procedure , 2006, 2006 IEEE International Conference on Wireless and Mobile Computing, Networking and Communications.

[33]  Chih-Jen Lin,et al.  The analysis of decomposition methods for support vector machines , 2000, IEEE Trans. Neural Networks Learn. Syst..

[34]  Jean T. Johnson Continuous-time, constant causative Markov chains , 1987 .

[35]  L. H. Crow Confidence Interval Procedures for the Weibull Process With Applications to Reliability Growth , 1982 .

[36]  Kai Lai Chung,et al.  A Course in Probability Theory , 1949 .

[37]  Petia Radeva,et al.  Personalization and user verification in wearable systems using biometric walking patterns , 2011, Personal and Ubiquitous Computing.

[38]  Larry H. Crow,et al.  Evaluating the reliability of repairable systems , 1990, Annual Proceedings on Reliability and Maintainability Symposium.

[39]  Mark Scott,et al.  PROPORTIONAL INTENSITIES AND STRONG ERGODICITY , 1983 .

[40]  Glenn R. Luecke,et al.  Nonhomogeneous, continuous-time Markov chains defined by series of proportional intensity matrices , 1989 .

[41]  H. Kushner,et al.  Stochastic Approximation and Recursive Algorithms and Applications , 2003 .

[42]  Benjamin Lipstein,et al.  Test Marketing: A Perturbation in the Market Place , 1968 .