Feature selection by merging sequential bidirectional search into relevance vector machine in condition monitoring

For more accurate fault detection and diagnosis, there is an increasing trend to use a large number of sensors and to collect data at high frequency. This inevitably produces large-scale data and causes difficulties in fault classification. Actually, the classification methods are simply intractable when applied to high-dimensional condition monitoring data. In order to solve the problem, engineers have to resort to complicated feature extraction methods to reduce the dimensionality of data. However, the features transformed by the methods cannot be understood by the engineers due to a loss of the original engineering meaning. In this paper, other forms of dimensionality reduction technique(feature selection methods) are employed to identify machinery condition, based only on frequency spectrum data. Feature selection methods are usually divided into three main types: filter, wrapper and embedded methods. Most studies are mainly focused on the first two types, whilst the development and application of the embedded feature selection methods are very limited. This paper attempts to explore a novel embedded method. The method is formed by merging a sequential bidirectional search algorithm into scale parameters tuning within a kernel function in the relevance vector machine. To demonstrate the potential for applying the method to machinery fault diagnosis, the method is implemented to rolling bearing experimental data. The results obtained by using the method are consistent with the theoretical interpretation, proving that this algorithm has important engineering significance in revealing the correlation between the faults and relevant frequency features. The proposed method is a theoretical extension of relevance vector machine, and provides an effective solution to detect the fault-related frequency components with high efficiency.

[1]  Michael E. Tipping Sparse Bayesian Learning and the Relevance Vector Machine , 2001, J. Mach. Learn. Res..

[2]  Andrew Ball,et al.  An Evaluation of the Potential Offered by a Relevance Vector Classifier in Fault Diagnosis , 2006 .

[3]  Mineichi Kudo,et al.  Comparison of algorithms that select features for pattern classifiers , 2000, Pattern Recognit..

[4]  Junichi Hori,et al.  Classification of silent speech using support vector machine and relevance vector machine , 2014, Appl. Soft Comput..

[5]  Özge Uncu,et al.  A novel feature selection approach: Combining feature wrappers and filters , 2007, Inf. Sci..

[6]  Suraj Prakash Harsha,et al.  Fault diagnosis of rolling element bearing with intrinsic mode function of acoustic emission data using APF-KNN , 2013, Expert Syst. Appl..

[7]  Ali Ajami,et al.  Data driven approach for fault detection and diagnosis of turbine in thermal power plant using Independent Component Analysis (ICA) , 2012 .

[8]  Yong Xu,et al.  A comparative study and improvement of two ICA using reference signal methods , 2014, Neurocomputing.

[9]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[10]  Abdolreza Ohadi,et al.  Comparison of FDA-based and PCA-based features in fault diagnosis of automobile gearboxes , 2013, Neurocomputing.

[11]  Dan Liu,et al.  Feature extraction of kernel regress reconstruction for fault diagnosis based on self-organizing manifold learning , 2013 .

[12]  Keinosuke Fukunaga,et al.  A Branch and Bound Algorithm for Feature Subset Selection , 1977, IEEE Transactions on Computers.

[13]  Fei Wang,et al.  Natural gas pipeline small leakage feature extraction and recognition based on LMD envelope spectrum entropy and SVM , 2014 .

[14]  Rajiv Tiwari,et al.  Support vector machine based optimization of multi-fault classification of gears with evolutionary algorithms from time–frequency vibration data , 2014 .

[15]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[16]  Liang Gong,et al.  Computer vision detection of defective apples using automatic lightness correction and weighted RVM classifier , 2015 .

[17]  V. Sugumaran,et al.  Fault diagnosis of monoblock centrifugal pump using SVM , 2014 .

[18]  Chao Liu,et al.  Global geometric similarity scheme for feature selection in fault diagnosis , 2014, Expert Syst. Appl..

[19]  M. S. Safizadeh,et al.  Using multi-sensor data fusion for vibration fault diagnosis of rolling element bearings by accelerometer and load cell , 2014, Inf. Fusion.

[20]  Jin Wen,et al.  A model-based fault detection and diagnostic methodology based on PCA method and wavelet transform , 2014 .

[21]  Mac McKee,et al.  Use of a relevance vector machine for groundwater quality monitoring network design under uncertainty , 2014, Environ. Model. Softw..

[22]  Lalit M. Patnaik,et al.  Genetic algorithms: a survey , 1994, Computer.

[23]  Wei Chen,et al.  Intelligent fault diagnosis of rotating machinery using support vector machine with ant colony algorithm for synchronous feature selection and parameter optimization , 2015, Neurocomputing.

[24]  Xue-wen Chen An improved branch and bound algorithm for feature selection , 2003, Pattern Recognit. Lett..

[25]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[26]  Guanghua Xu,et al.  Feature extraction and recognition for rolling element bearing fault utilizing short-time Fourier transform and non-negative matrix factorization , 2014, Chinese Journal of Mechanical Engineering.

[27]  Kui Zhang,et al.  Feature selection for high-dimensional machinery fault diagnosis data using multiple models and Radial Basis Function networks , 2011, Neurocomputing.

[28]  Fengshou Gu,et al.  A novel feature selection algorithm for high-dimensional condition monitoring data , 2011 .

[29]  Liang Gao,et al.  An active learning genetic algorithm for integrated process planning and scheduling , 2012, Expert Syst. Appl..

[30]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .