Anomaly Detection Via Self-Organizing Map

Anomaly detection plays a key role in industrial manufacturing for product quality control. Traditional methods for anomaly detection are rule-based with limited generalization ability. Recent methods based on supervised deep learning are more powerful but require large-scale annotated datasets for training. In practice, abnormal products are rare thus it is very difficult to train a deep model in a fully supervised way. In this paper, we propose a novel unsupervised anomaly detection approach based on Self-organizing Map (SOM). Our method, Self-organizing Map for Anomaly Detection (SOMAD) maintains normal characteristics by using topological memory based on multi-scale features. SOMAD achieves state-of the-art performance on unsupervised anomaly detection and localization on the MVTec dataset.

[1]  Bodo Rosenhahn,et al.  Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flows , 2020, 2021 IEEE Winter Conference on Applications of Computer Vision (WACV).

[2]  Nikos Komodakis,et al.  Wide Residual Networks , 2016, BMVC.

[3]  Romaric Audigier,et al.  PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localization , 2020, ICPR Workshops.

[4]  PANDA - Adapting Pretrained Features for Anomaly Detection , 2020, ArXiv.

[5]  Svetha Venkatesh,et al.  Memorizing Normality to Detect Anomaly: Memory-Augmented Deep Autoencoder for Unsupervised Anomaly Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[6]  Gianluca Cerminara,et al.  Anomaly Detection with Conditional Variational Autoencoders , 2019, 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA).

[7]  C. Steger,et al.  Uninformed Students: Student-Teacher Anomaly Detection With Discriminative Latent Embeddings , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Ramesh Nallapati,et al.  OCGAN: One-Class Novelty Detection Using GANs With Constrained Latent Representations , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Zhenyu Li,et al.  Superpixel Masking and Inpainting for Self-Supervised Anomaly Detection , 2020, BMVC.

[10]  Carsten Steger,et al.  MVTec AD — A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Dorit Merhof,et al.  Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detection , 2021, 2020 25th International Conference on Pattern Recognition (ICPR).

[12]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[13]  Gian Luca Foresti,et al.  Image Anomaly Detection by Aggregating Deep Pyramidal Representations , 2020, ICPR Workshops.

[14]  Georg Langs,et al.  f‐AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks , 2019, Medical Image Anal..

[15]  Ghassan AlRegib,et al.  Novelty Detection Through Model-Based Characterization of Neural Networks , 2020, 2020 IEEE International Conference on Image Processing (ICIP).

[16]  Pierre Eline,et al.  Anomaly localization by modeling perceptual features , 2020, ArXiv.

[17]  Sungroh Yoon,et al.  Patch SVDD: Patch-level SVDD for Anomaly Detection and Segmentation , 2020, ArXiv.

[18]  Jan Kautz,et al.  Loss Functions for Neural Networks for Image Processing , 2015, ArXiv.

[19]  Yedid Hoshen,et al.  Transformer-Based Anomaly Segmentation , 2020 .

[20]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[21]  Yedid Hoshen,et al.  Deep Nearest Neighbor Anomaly Detection , 2020, ArXiv.

[22]  Yu-Chiang Frank Wang,et al.  Learning Disentangled Feature Representations For Anomaly Detection , 2020, 2020 IEEE International Conference on Image Processing (ICIP).

[23]  Bhanukiran Vinzamuri,et al.  Unsupervised anomaly detection with adversarial mirrored autoencoders , 2020, UAI.

[24]  Toby P. Breckon,et al.  GANomaly: Semi-Supervised Anomaly Detection via Adversarial Training , 2018, ACCV.

[25]  Stanislav Pidhorskyi,et al.  Generative Probabilistic Novelty Detection with Adversarial Autoencoders , 2018, NeurIPS.

[26]  Teuvo Kohonen,et al.  Essentials of the self-organizing map , 2013, Neural Networks.

[27]  P. Mahalanobis.  On the generalized distance in statistics , 1936 .

[28]  Bir Bhanu,et al.  Towards Visually Explaining Variational Autoencoders , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Cewu Lu,et al.  Attribute Restoration Framework for Anomaly Detection , 2019, IEEE Transactions on Multimedia.