Anomaly detection based on Non-negative matrix factorization in stock market

The anomalous fluctuations of the stock market should affect the normal operation of the whole financial market, trigger the release of all kinds of unstable factors in financial operation. Therefore, we can quickly find potential risks in the market by analyzing the data of the stock market and detecting anomaly fluctuations. Due to the stock market to produce huge amounts of data, the data processing power demand is high. So detecting anomalous point fast, efficiently and accurately is important the research direction. In the article, we consider the time sequence characteristics of stock data, use the method of non-negative matrix factorization(NMF)to acquire weight coefficient set that denote the characteristic of stock date perfectly .Then these weight coefficient set is decomposed by wavelet transform, so, we can calculate the abnormal fluctuations from all of decomposition hierarchy. Finally, anomaly fluctuations can be quickly and accurately positioned out by means of weighted fusion. In the process of anomalous fluctuations detection, we introduce the weight fusion means, implement two weight, and find out abnormal points finally. In this way, more accurate detection result can be obtained. The empirical analysis found that our method is coincident with real condition, it can ensure higher detection accuracy besides persistent fluctuation in certain time period. Keyword: Anomaly detection; Non-negative matrix factorization; Data mining; Feature extraction

[1]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[2]  Sergio Cruces,et al.  Generalized Alpha-Beta Divergences and Their Application to Robust Nonnegative Matrix Factorization , 2011, Entropy.

[3]  Werner Kristjanpoller,et al.  Gold price volatility: A forecasting approach using the Artificial Neural Network-GARCH model , 2015, Expert Syst. Appl..

[4]  P. Franses,et al.  Additive outliers, GARCH and forecasting volatility , 1999 .

[5]  Seungjin Choi,et al.  Semi-Supervised Nonnegative Matrix Factorization , 2010, IEEE Signal Processing Letters.

[6]  Maumita Bhattacharya,et al.  Intelligent Financial Fraud Detection: A Comprehensive Review , 2015 .

[7]  Agus Sudjianto,et al.  Statistical Methods for Fighting Financial Crimes , 2010, Technometrics.

[8]  Dong Hoon Lee,et al.  Fraud and financial crime detection model using malware forensics , 2013, Multimedia Tools and Applications.

[9]  Asok Ray,et al.  Symbolic time series analysis for anomaly detection: A comparative evaluation , 2005, Signal Process..

[10]  Md. Rafiqul Islam,et al.  A survey of anomaly detection techniques in financial domain , 2016, Future Gener. Comput. Syst..

[11]  M. King,et al.  Influence Diagnostics in Generalized Autoregressive Conditional Heteroscedasticity Processes , 2005 .

[12]  Weiwei Sun,et al.  Band selection using sparse nonnegative matrix factorization with the thresholded Earth’s mover distance for hyperspectral imagery classification , 2015, Earth Science Informatics.

[13]  Canan Bilen,et al.  Wavelet-Based Detection of Outliers in Time Series , 2002 .

[14]  Asok Ray,et al.  Symbolic dynamic analysis of complex systems for anomaly detection , 2004, Signal Process..

[15]  Helena Veiga,et al.  Wavelet-based detection of outliers in financial time series , 2010, Comput. Stat. Data Anal..

[16]  Reda Alhajj,et al.  Graph-based approach for outlier detection in sequential data and its application on stock market and weather data , 2014, Knowl. Based Syst..

[17]  Olivier Darné,et al.  Outliers and GARCH models in financial data , 2005 .

[18]  T. Bollerslev,et al.  Answering the Critics: Yes, Arch Models Do Provide Good Volatility Forecasts , 1997 .

[19]  P. Harries,et al.  Factors used in the detection of elder financial abuse: A judgement and decision-making study of social workers and their managers , 2011 .

[20]  Seungjin Choi,et al.  Orthogonal nonnegative matrix tri-factorization for co-clustering: Multiplicative updates on Stiefel manifolds , 2010, Inf. Process. Manag..

[21]  Guillermo Sapiro,et al.  Compressed Nonnegative Matrix Factorization Is Fast and Accurate , 2015, IEEE Transactions on Signal Processing.