Chapter 35 Novelty Detection

Encyclopedia of Structural Health Monitoring. Edited by Christian Boller, Fu-Kuo Chang and Yozo Fujino  2009 John Wiley & Sons, Ltd. ISBN: 978-0-470-05822-0. of possible failure modes, the effects of which on observable (sensor) data are often poorly defined. To compound this, examples of abnormal behavior in high-integrity systems are few and far between; usually, there are insufficient examples of failure to construct accurate fault-detection systems. As a result, conventional fault-specific failure-detection schemes are usually limited to identifying a small subset of known, well-understood modes of failure. An alternative to identifying rare and unexpected modes of failure is the novelty detection paradigm [1–5], in which a model of normality is constructed from normal system data. Departures from normal behavior are classified as novel events. Novelty detection is alternatively known as one-class classification [6] or outlier detection [7].

[1]  R. Fisher,et al.  Limiting forms of the frequency distribution of the largest or smallest member of a sample , 1928, Mathematical Proceedings of the Cambridge Philosophical Society.

[2]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[3]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[4]  C. D. Kemp,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[5]  D. N. Geary.  Mixture Models: Inference and Applications to Clustering , 1989 .

[6]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[7]  Christopher M. Bishop,et al.  Novelty detection and neural network validation , 1994 .

[8]  Stephen J. Roberts,et al.  A Probabilistic Resource Allocating Network for Novelty Detection , 1994, Neural Computation.

[9]  Padhraic Smyth,et al.  Markov monitoring with unknown states , 1994, IEEE J. Sel. Areas Commun..

[10]  Michael Brady,et al.  Novelty detection for the identification of masses in mammograms , 1995 .

[11]  Don R. Hush,et al.  Network constraints and multi-objective optimization for one-class classification , 1996, Neural Networks.

[12]  Gunter Ritter,et al.  Outliers in statistical pattern recognition and an application to automatic chromosome classification , 1997, Pattern Recognit. Lett..

[13]  Robert P. W. Duin,et al.  Novelty Detection Using Self-Organizing Maps , 1997, ICONIP.

[14]  Robert P. W. Duin,et al.  Data domain description using support vectors , 1999, ESANN.

[15]  S. Roberts.  Novelty detection using extreme value statistics , 1999 .

[16]  Bernhard Schölkopf,et al.  Support Vector Method for Novelty Detection , 1999, NIPS.

[17]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory, Second Edition , 2000, Statistics for Engineering and Information Science.

[18]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[19]  Bernhard Schölkopf,et al.  Support Vector Novelty Detection Applied to Jet Engine Vibration Spectra , 2000, NIPS.

[20]  S. Roberts.  EXTREME VALUE STATISTICS FOR NOVELTY DETECTION IN BIOMEDICAL DATA PROCESSING , 2000 .

[21]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[22]  Terrence J. Sejnowski,et al.  Variational Learning for Switching State-Space Models , 2001 .

[23]  Ian T. Nabney,et al.  Netlab: Algorithms for Pattern Recognition , 2002 .

[24]  Khaled Labib,et al.  NSOM: A Real-Time Network-Based Intrusion Detection System Using Self-Organizing Maps , 2002 .

[25]  Yuxin Ding,et al.  Host-based intrusion detection using dynamic and static behavioral models , 2003, Pattern Recognit..

[26]  Yudi Agusta,et al.  Unsupervised learning of Gamma mixture models using Minimum Message Length , 2003 .

[27]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[28]  Michael E. Tipping,et al.  Feed-forward neural networks and topographic mappings for exploratory data analysis , 1996, Neural Computing & Applications.

[29]  Itay Mayrose,et al.  A Gamma mixture model better accounts for among site rate heterogeneity , 2005, ECCB/JBI.

[30]  Lionel Tarassenko,et al.  Static and dynamic novelty detection methods for jet engine health monitoring , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[31]  David A. Clifton,et al.  Learning Shape for Jet Engine Novelty Detection , 2006, ISNN.

[32]  Sameer Singh,et al.  A Neural Network-Based Novelty Detector for Image Sequence Analysis , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[34]  David A. Clifton,et al.  A Framework for Novelty Detection in Jet Engine Vibration Data , 2007 .

[35]  John A. Quinn,et al.  Known Unknowns: Novelty Detection in Condition Monitoring , 2007, IbPRIA.