A New Anomaly Detection Algorithm Based on Quantum Mechanics

The primary originality of this paper lies at the fact that we have made the first attempt to apply quantum mechanics theory to anomaly (outlier) detection in high-dimensional datasets for data mining. We propose Fermi Density Descriptor (FDD) which represents the probability of measuring a fermion at a specific location for anomaly detection. We also quantify and examine different Laplacian normalization effects and choose the best one for anomaly detection. Both theoretical proof and quantitative experiments demonstrate that our proposed FDD is substantially more discriminative and robust than the commonly-used algorithms.

[1]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[2]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[3]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[4]  C. Marzban.  The ROC Curve and the Area under It as Performance Measures , 2004 .

[5]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[6]  Kai Ming Ting,et al.  Mass estimation and its applications , 2010, KDD.

[7]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD '00.

[8]  Christos Faloutsos,et al.  LOCI: fast outlier detection using the local correlation integral , 2003, Proceedings 19th International Conference on Data Engineering (Cat. No.03CH37405).

[9]  R. Coifman,et al.  Non-linear independent component analysis with diffusion maps , 2008 .

[10]  Zhi-Hua Zhou,et al.  Isolation Forest , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[11]  Stéphane Lafon,et al.  Diffusion maps , 2006 .

[12]  Carla E. Brodley,et al.  Anomaly Detection Using an Ensemble of Feature Models , 2010, 2010 IEEE International Conference on Data Mining.

[13]  A. Zajonc,et al.  The Quantum Challenge: Modern Research on the Foundations of Quantum Mechanics , 1997 .

[14]  Hao Huang,et al.  A Robust Clustering Algorithm Based on Aggregated Heat Kernel Mapping , 2011, 2011 IEEE 11th International Conference on Data Mining.

[15]  Fabio A. González,et al.  Anomaly Detection Using Real-Valued Negative Selection , 2003, Genetic Programming and Evolvable Machines.

[16]  D. W. Zimmerman.  Teacher’s Corner: A Note on Interpretation of the Paired-Samples t Test , 1997 .

[17]  Arindam Banerjee,et al.  Anomaly Detection in Transportation Corridors using Manifold Embedding , 2007 .

[18]  B. Nadler,et al.  Diffusion maps, spectral clustering and reaction coordinates of dynamical systems , 2005, math/0503445.

[19]  Sanjay Chawla,et al.  Finding Local Anomalies in Very High Dimensional Space , 2010, 2010 IEEE International Conference on Data Mining.

[20]  Daniel Cremers,et al.  The wave kernel signature: A quantum mechanical approach to shape analysis , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).