Smoothing gamma ray spectra to improve outlier detection

Rapid detection of radioisotopes in gamma-ray data can, in some situations, be an important security concern. The task of designing an automated system for this purpose is complex due to, amongst other factors, the noisy nature of the data. The method described herein consists of preprocessing the data by applying a smoothing method tailored to gamma ray spectra, hoping that this should decrease their variance. Given that the number of counts at a given energy level in a spectrum should follow a Poisson distribution, smoothing may allow us to estimate the true photon arrival rate. Our experiments suggest that the added data preprocessing step can have large impact on the performance of anomaly detection algorithms on this particular domain.

[1]  G. S. Watson,et al.  Smooth regression analysis , 1964 .

[2]  T Burr,et al.  Smoothing Low Resolution Gamma Spectra , 2010, IEEE Transactions on Nuclear Science.

[3]  Prabhakar Raghavan,et al.  A Linear Method for Deviation Detection in Large Databases , 1996, KDD.

[4]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[5]  Haym Hirsh,et al.  The Problem with Noise and Small Disjuncts , 1998, ICML.

[6]  S. Garner,et al.  Wavelet Analysis of Sodium Iodide Spectra , 2006, IEEE Transactions on Nuclear Science.

[7]  Matthew P. Wand,et al.  Kernel Smoothing , 1995 .

[8]  A. Sockloff,et al.  Statistical power analysis for the behavioral sciences: (revised edition), by Jacob Cohen. New York: Academic Press, 1977, xv + 474 pp., $24.50. , 1978 .

[9]  C. R. Deboor,et al.  A practical guide to splines , 1978 .

[10]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[11]  Mohak Shah,et al.  Evaluating Learning Algorithms: A Classification Perspective , 2011 .

[12]  M. Braga,et al.  Exploratory Data Analysis , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[13]  Nathalie Japkowicz,et al.  A Novelty Detection Approach to Classification , 1995, IJCAI.

[14]  Raymond T. Ng,et al.  A unified approach for mining outliers , 1997, CASCON.

[15]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[16]  Misha Denil,et al.  Overlap versus Imbalance , 2010, Canadian Conference on AI.

[17]  Chandan Srivastava,et al.  Support Vector Data Description , 2011 .

[18]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[19]  Gary M. Weiss.  Mining with rarity: a unifying framework , 2004, SKDD.

[20]  P. Mahalanobis.  On the generalized distance in statistics , 1936 .

[21]  Nathalie Japkowicz,et al.  Anomaly detection in gamma ray spectra: A machine learning perspective , 2012, 2012 IEEE Symposium on Computational Intelligence for Security and Defence Applications.

[22]  E. Nadaraya.  On Estimating Regression , 1964 .

[23]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD '00.