A reinforcement neural architecture search method for rolling bearing fault diagnosis

Abstract The fault diagnosis of rolling bearing has always been a research hotspot, and it is an urgent task to develop the effective method for rolling bearing fault identification. Most traditional methods cannot automatically build appropriately models for different datasets. In this paper, a neural network architecture automatic search method based on reinforcement learning is proposed for fault diagnosis of rolling bearings. The framework of proposed method contains of two components: a controller model and child models. The controller is recurrent neural network (RNN) and generates a series of actions, each action specifies a design choice to construct the child models for fault diagnosis. Then, the controller parameters are updated using the policy gradient method of reinforcement learning by maximizing the accuracy of the child models. The results confirm that the proposed method can realize the automatic design of neural network architecture and overcome the limitation of traditional methods.

[1]  Nanning Zheng,et al.  Person Re-identification by Multi-Channel Parts-Based CNN with Improved Triplet Loss Function , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Amin W. Mugera,et al.  Vulnerability to Multi-Dimensional Poverty: An Empirical Comparison of Alternative Measurement Approaches , 2018 .

[3]  Haidong Shao,et al.  Rolling bearing fault diagnosis using adaptive deep belief network with dual-tree complex wavelet packet. , 2017, ISA transactions.

[4]  Yanhui Guo,et al.  A retinal vessel detection approach using convolution neural network with reinforcement sample learning strategy , 2018, Measurement.

[5]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[6]  Pedro Ferreira,et al.  An MDP Model-Based Reinforcement Learning Approach for Production Station Ramp-Up Optimization: Q-Learning Analysis , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[7]  Hongkai Jiang,et al.  An improved EEMD with multiwavelet packet for rotating machinery multi-fault diagnosis , 2013 .

[8]  Yuxi Li,et al.  Deep Reinforcement Learning , 2018, Reinforcement Learning for Cyber-Physical Systems.

[9]  Wei Xu,et al.  Deep Captioning with Multimodal Recurrent Neural Networks (m-RNN) , 2014, ICLR.

[10]  Cong Wang,et al.  Non-negative EMD manifold for feature extraction in machinery fault diagnosis , 2015 .

[11]  Haidong Shao,et al.  Rolling bearing fault feature learning using improved convolutional deep belief network with compressed sensing , 2018 .

[12]  Wei Gao,et al.  A Novel Fault Diagnosis Method for Rotating Machinery Based on a Convolutional Neural Network , 2018, Sensors.

[13]  Haidong Shao,et al.  A novel method for intelligent fault diagnosis of rolling bearings using ensemble deep auto-encoders , 2018 .

[14]  Jinbao Yang,et al.  Weighing method for truck scale based on neural network with weight-smoothing constraint , 2017 .

[15]  Xiaodong Wang,et al.  Rolling bearing fault detection using an adaptive lifting multiwavelet packet with a dimension spectrum , 2013 .

[16]  Haidong Shao,et al.  Improved Deep Transfer Auto-Encoder for Fault Diagnosis of Gearbox Under Variable Working Conditions With Small Training Samples , 2019, IEEE Access.

[17]  Haiyang Pan,et al.  A fault diagnosis approach for roller bearing based on symplectic geometry matrix machine , 2019, Mechanism and Machine Theory.

[18]  Jinde Zheng,et al.  A Novel Roller Bearing Condition Monitoring Method Based on RHLCD and FVPMCD , 2019, IEEE Access.

[19]  Peter Corcoran,et al.  Traffic Light Control Using Deep Policy-Gradient and Value-Function Based Reinforcement Learning , 2017, ArXiv.

[20]  Emanuel Todorov,et al.  Policy gradients in linearly-solvable MDPs , 2010, NIPS.

[21]  N. Daw,et al.  Reinforcement Learning and Episodic Memory in Humans and Animals: An Integrative Framework , 2017, Annual review of psychology.

[22]  Wayne Goodridge,et al.  S-MDP: Streaming With Markov Decision Processes , 2019, IEEE Transactions on Multimedia.

[23]  Alex Graves,et al.  Playing Atari with Deep Reinforcement Learning , 2013, ArXiv.

[24]  Yan Han,et al.  Multi-level wavelet packet fusion in dynamic ensemble convolutional neural network for fault diagnosis , 2018, Measurement.

[25]  Yu Yang,et al.  Enhanced deep gated recurrent unit and complex wavelet packet energy moment entropy for early fault prognosis of bearing , 2020, Knowl. Based Syst..

[26]  Liang Chen,et al.  Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis , 2016 .

[27]  Yao Liu,et al.  Land cover classification of RADARSAT-2 SAR data using convolutional neural network , 2016, Wuhan University Journal of Natural Sciences.

[28]  Cancan Yi,et al.  Quaternion singular spectrum analysis using convex optimization and its application to fault diagnosis of rolling bearing , 2017 .

[29]  Kai Xie,et al.  Non-contact resistance and capacitance on-line measurement of lubrication oil film in rolling element bearing employing an electric field coupling method , 2016 .

[30]  Lubos Brim,et al.  Precise parameter synthesis for stochastic biochemical systems , 2014, Acta Informatica.

[31]  Haidong Shao,et al.  Electric Locomotive Bearing Fault Diagnosis Using a Novel Convolutional Deep Belief Network , 2018, IEEE Transactions on Industrial Electronics.