Introduction of a Novel Anomalous Sound Detection Methodology

This paper is to introduce a novel semi-supervised methodology, the enhanced incremental principal component analysis (“IPCA”) based deep convolutional neural network autoencoder (“DCNN-AE) for Anomalous Sound Detection (“ASD”) with high accuracy and computing efficiency. This hybrid methodology is to adopt Enhanced IPCA to reduce the dimensionality and then to use DCNN-AE to extract the features of the sample sound and detect the anomality. In this project, 228 sets of normal sounds and 100 sets of anomaly sounds of same machine are used for the experiments. And the sound files of machines (stepper motors) for the experiments are collected from a plant site. 50 random test cases are executed to evaluate the performance of the algorithm with AUC, PAUC, F measure and Accuracy Score. IPCA Based DCNN-AE shows high accuracy with the average AUC of 0.815793282, comparing with that of Kmeans++ of 0.499545351, of Incremental PCA based DBSCAN clustering of 0.636348073, of Incremental based PCA based One-class SVM of 0.506749433 and of DCGAN of 0.716528104. From the perspective of computing efficiency, because of the dimensions-reduction by the IPCA layer, the average execution time of the new methodology is 15 minutes in the CPU computing module of 2.3 GHz quad-core processors, comparing with that of DCGAN with 90 minutes in GPU computing module of 4 to 8 kernels.

[1]  F. Masulli,et al.  Anomalous sound event detection: A survey of machine learning based methods and applications , 2021, Multimedia Tools and Applications.

[2]  Zhong Fan,et al.  Anomaly Detection for IoT Time-Series Data: A Survey , 2020, IEEE Internet of Things Journal.

[3]  Takashi Endo,et al.  Description and Discussion on DCASE2020 Challenge Task2: Unsupervised Anomalous Sound Detection for Machine Condition Monitoring , 2020, DCASE.

[4]  Sung-Jin Song,et al.  Performance enhancement of convolutional neural network for ultrasonic flaw classification by adopting autoencoder , 2020 .

[5]  Hyun Jung Kim,et al.  An Automobile Environment Detection System Based on Deep Neural Network and its Implementation Using IoT-Enabled In-Vehicle Air Quality Sensors , 2020 .

[6]  Xiao Tan,et al.  Genetic Algorithm Based Bi-directional Generative Adversary Network for LIBOR Prediction , 2020, EIDWT.

[7]  Dokkyun Yi,et al.  An Effective Optimization Method for Machine Learning Based on ADAM , 2020, Applied Sciences.

[8]  M. Cesarelli,et al.  Linear discriminant analysis and principal component analysis to predict coronary artery disease , 2020, Health Informatics J..

[9]  Yohei Kawaguchi,et al.  MIMII Dataset: Sound Dataset for Malfunctioning Industrial Machine Investigation and Inspection , 2019, DCASE.

[10]  Carolina Counties,et al.  Agglomerative Hierarchical Clustering , 2019, Clustering Methodology for Symbolic Data.

[11]  Yuma Koizumi,et al.  ToyADMOS: A Dataset of Miniature-Machine Operating Sounds for Anomalous Sound Detection , 2019, 2019 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA).

[12]  David Wood,et al.  IoT Data Management System for Rapid Development of Machine Learning Models , 2019, 2019 IEEE International Conference on Cognitive Computing (ICCC).

[13]  Stella X. Yu,et al.  Unsupervised Feature Learning via Non-parametric Instance Discrimination , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  Jun Jo,et al.  Application of deep neural network and generative adversarial network to industrial maintenance: A case study of induction motor fault detection , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[15]  Randy C. Paffenroth,et al.  Anomaly Detection with Robust Deep Autoencoders , 2017, KDD.

[16]  N. Harada,et al.  Anomaly Detection Technique in Sound to Detect Faulty Equipment , 2017, NTT Technical Review.

[17]  Wei Shi,et al.  Dilated convolution neural network with LeakyReLU for environmental sound classification , 2017, 2017 22nd International Conference on Digital Signal Processing (DSP).

[18]  Yufei Tao,et al.  On the Hardness and Approximation of Euclidean DBSCAN , 2017, ACM Trans. Database Syst..

[19]  Mohsen Guizani,et al.  Deep Feature Learning for Medical Image Analysis with Convolutional Autoencoder Neural Network , 2017, IEEE Transactions on Big Data.

[20]  Xiaoou Tang,et al.  Accelerating the Super-Resolution Convolutional Neural Network , 2016, ECCV.

[21]  Yu Cheng,et al.  Deep Structured Energy Based Models for Anomaly Detection , 2016, ICML.

[22]  Jian Hou,et al.  Recent advances on SVM based fault diagnosis and process monitoring in complicated industrial processes , 2016, Neurocomputing.

[23]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[24]  Elad Hazan,et al.  Fast and Simple PCA via Convex Optimization , 2015, ArXiv.

[25]  Justin Salamon,et al.  Unsupervised feature learning for urban sound classification , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[27]  Pierre Baldi,et al.  Deep autoencoder neural networks for gene ontology annotation predictions , 2014, BCB.

[28]  Marius Kloft,et al.  Toward Supervised Anomaly Detection , 2014, J. Artif. Intell. Res..

[29]  Sanjoy Dasgupta,et al.  The Fast Convergence of Incremental PCA , 2013, NIPS.

[30]  Tara N. Sainath,et al.  Deep convolutional neural networks for LVCSR , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[31]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[32]  Greg Sullivan,et al.  Operations & Maintenance Best Practices - A Guide to Achieving Operational Efficiency (Release 3) , 2010 .

[33]  Myra Spiliopoulou,et al.  C-DBSCAN: Density-Based Clustering with Constraints , 2009, RSFDGrC.

[34]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[35]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[36]  Ray Pugh,et al.  Operations and Maintenance Best Practices--A Guide to Achieving Operational Efficiency , 2002 .

[37]  Michael Lindenbaum,et al.  Sequential Karhunen-Loeve basis extraction and its application to images , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[38]  Michael Isard,et al.  The CONDENSATION Algorithm - Conditional Density Propagation and Applications to Visual Tracking , 1996, NIPS.

[39]  Martin Klimo,et al.  Anomaly detection using Autoencoders and Deep Convolution Generative Adversarial Networks , 2021, Transportation Research Procedia.

[40]  Johannes R. Sveinsson,et al.  Hyperspectral Unmixing Using a Neural Network Autoencoder , 2018, IEEE Access.

[41]  Hugo Vieira Neto,et al.  Incremental PCA: an alternative approach for novelty detection , 2005 .

[42]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.