Application of Deep Belief Networks for Precision Mechanism Quality Inspection

Precision mechanism is widely used for various industry applications. Quality inspection for precision mechanism is essential for manufacturers to assure the product leaving factory with expected quality. In this paper, we propose a novel automated fault detection method, named Tilear, based on a Deep Belief Network (DBN) auto-encoder. DBN is a probabilistic generative model, composed by stacked Restricted Boltzmann Machines. With its RBM-layer-wise training methods, DBN can perform fast inference and extract high level feature of the inputs. By unfolding the stacked RBMs symmetrically, a DBN auto-encoder is constructed to reconstruct the inputs as closely as possible. Based on the DBN auto-encoder, Tilear is structured in two parts: training and decision-making. During training, Tilear is trained with the signals only from good samples, which enables the trained DBN auto-encoder only know how to reconstruct signals of good samples. In the decision-making part, comparing the recorded signal from test sample and the Tilear reconstructed signal, allows to measure how well a recording from a test sample matches the DBN auto-encoder model learned from good samples. A reliable decision could be made. We perform experiments on two different precision mechanisms: precision electromotors and greasing control units. The feasibility of Tilear was demonstrated first. Additionally, performance of Tilear on the acquired electromotor dataset was compared with the state-of-the-art machine learning based fault detection technique, support vector machine (SVM). First result indicates that Tilear excels the SVM in terms of the Area Under the Curve (AUC) obtained from the Receiver Operating Characteristics (ROC) curve plot: 0.960 achieved by Tilear, while 0.941 by SVM.

[1]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[2]  Junyan Yang,et al.  Intelligent fault diagnosis of rolling element bearing based on SVMs and fractal dimension , 2007 .

[3]  Jian-Jiun Ding,et al.  Bearing Fault Diagnosis Based on Multiscale Permutation Entropy and Support Vector Machine , 2012, Entropy.

[4]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[5]  Lior Rokach,et al.  Data Mining And Knowledge Discovery Handbook , 2005 .

[6]  Markus Timusk,et al.  Feature extraction for novelty detection as applied to fault detection in machinery , 2011, Pattern Recognit. Lett..

[7]  Nitesh V. Chawla,et al.  Data Mining for Imbalanced Datasets: An Overview , 2005, The Data Mining and Knowledge Discovery Handbook.

[8]  Felix Naumann,et al.  Data fusion , 2009, CSUR.

[9]  Bin Zhang,et al.  Rolling element bearing feature extraction and anomaly detection based on vibration monitoring , 2008, 2008 16th Mediterranean Conference on Control and Automation.

[10]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[11]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[12]  Jing Yang,et al.  Fault detection and diagnosis of permanent-magnet DC motor based on parameter estimation and neural network , 2000, IEEE Trans. Ind. Electron..

[13]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[14]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[15]  T.Y. Lin,et al.  Anomaly detection , 1994, Proceedings New Security Paradigms Workshop.