Fault diagnosis for power transformer using deep learning and softmax regression

In order to solve the problems such as availability of data extraction, better local optimum, gradient to dissipate more efficiently, this paper presents a new method of power transformer fault diagnosis based on deep learning and Softmax classifier. Power transformer fault diagnosis model is established based on stacked auto-encoders and softmax regression, then each restricted boltzmann machine of fault diagnosis model is optimized by the unsupervised raining with massive unlabeled samples based on k-step contrastive divergence and adjusts parameters of fault diagnosis model by the supervised algorithm. Finally, the power transformer fault types are determined by Softmax regression. Test results show that the proposed method has higher diagnosis accuracy and better adaptability than those based on the back propagation neural network and the support vector machine.

[1]  Pascal Vincent,et al.  Unsupervised Feature Learning and Deep Learning: A Review and New Perspectives , 2012, ArXiv.

[2]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[3]  Soumaya Yacout,et al.  Parameter Estimation Methods for Condition-Based Maintenance With Indirect Observations , 2010, IEEE Transactions on Reliability.

[4]  Hao Xiang,et al.  The Application of Genetic BP Neural Network and D-S Evidence Theory in the Complex System Fault Diagnosis , 2012 .

[5]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[6]  Lijing Zhang,et al.  A fast method of face detection in video images , 2010, 2010 2nd International Conference on Advanced Computer Control.

[7]  Christian Igel,et al.  An Introduction to Restricted Boltzmann Machines , 2012, CIARP.

[8]  Derek C. Rose,et al.  Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[9]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[10]  W.H. Tang,et al.  A Probabilistic Classifier for Transformer Dissolved Gas Analysis With a Particle Swarm Optimizer , 2008, IEEE Transactions on Power Delivery.

[11]  V. Ebrahimipour,et al.  A flexible algorithm for fault diagnosis in a centrifugal pump with corrupted data and noise based on ANN and support vector machine with hyper-parameters optimization , 2013, Appl. Soft Comput..

[12]  Peter Glöckner,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2013 .

[13]  Ruijin Liao,et al.  An Integrated Decision-Making Model for Condition Assessment of Power Transformers Using Fuzzy Approach and Evidential Reasoning , 2011, IEEE Transactions on Power Delivery.

[14]  M. M. A. Salama,et al.  Determination of transformer health condition using artificial neural networks , 2011, 2011 International Symposium on Innovations in Intelligent Systems and Applications.