Anomaly detection in homogenous populations: A sparse multiple kernel-based regularization method

A problem of anomaly detection in homogenous populations consisting of linear stable systems is studied. The recently introduced sparse multiple kernel based regularization method is applied to solve the problem. A common problem with the existing regularization methods is that there lacks an efficient and systematic way to tune the involved regularization parameters. In contrast, the hyper-parameters (some of them can be interpreted as regularization parameters) involved in the proposed method are tuned in an automatic way, and in fact estimated by using the empirical Bayes method. What's more, both the parameter and hyper-parameter estimation problems can be cast as convex and sequential convex optimization problems. It is possible to derive scalable solutions to both the parameter and hyper-parameter estimation problems and thus provide a scalable solution to the anomaly detection.

[1]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[2]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[3]  D. Hunter,et al.  A Tutorial on MM Algorithms , 2004 .

[4]  David P. Wipf,et al.  A unified Bayesian framework for MEG/EEG source imaging , 2009, NeuroImage.

[5]  Giuseppe De Nicolao,et al.  A new kernel-based approach for linear system identification , 2010, Autom..

[6]  Alessandro Chiuso,et al.  Prediction error identification of linear systems: A nonparametric Gaussian regression approach , 2011, Autom..

[7]  Stephen P. Boyd,et al.  Scalable Statistical Monitoring of Fleet Data , 2011, IFAC Proceedings Volumes.

[8]  Lisa Turner,et al.  Applications of Second Order Cone Programming , 2012 .

[9]  Dimitry M. Gorinevsky,et al.  Aircraft anomaly detection using performance models trained on fleet data , 2012, 2012 Conference on Intelligent Data Understanding.

[10]  Henrik Ohlsson,et al.  On the estimation of transfer functions, regularizations and Gaussian processes - Revisited , 2012, Autom..

[11]  Alexander Medvedev,et al.  Non-parametric analysis of eye-tracking data by anomaly detection , 2013, 2013 European Control Conference (ECC).

[12]  Lennart Ljung,et al.  Kernel methods in system identification, machine learning and function estimation: A survey , 2014, Autom..

[13]  Henrik Ohlsson,et al.  Scalable anomaly detection in large homogeneous populations , 2013, Autom..

[14]  Lennart Ljung,et al.  System Identification Via Sparse Multiple Kernel-Based Regularization Using Sequential Convex Optimization Techniques , 2014, IEEE Transactions on Automatic Control.

[15]  L. Ljung,et al.  Constructive state space model induced kernels for regularized system identification , 2014 .

[16]  A. Medvedev,et al.  Stochastic anomaly detection in eye-tracking data for quantification of motor symptoms in Parkinson's disease. , 2015, Advances in experimental medicine and biology.