Microscopic Machine Vision Based Degradation Monitoring of Low-Voltage Electromagnetic Coil Insulation Using Ensemble Learning in a Membrane Computing Framework

In this paper, a novel microscopic machine vision system is proposed to solve a degradation monitoring problem of low-voltage electromagnetic coil insulation in practical industrial fields, where an ensemble learning approach in a compound membrane computing framework is newly introduced. This membrane computing framework is constituted by eight layers, 29 membranes, 72 objects, and 35 rules. In this framework, multiple machine learning methods, including classical pattern recognition methods and novel deep learning methods, are tested and compared. First, the most optimal feature extraction approaches are selected. Then, the selected approaches are fused together to achieve an even better monitoring performance. Third, a large number of experiments are used to evaluate and prove the usefulness and potential of the proposed system, where a mean accuracy of 61.4% is achieved on 1035 validation images of six degradation states with single state matching, and mean accuracies of 61.0% and 77.4% are achieved on 622 test images of six degradation states with single state matching and state range matching, respectively. Finally, a mechanical device is designed to apply the system to real industrial tasks.

[1]  Grigori Sidorov,et al.  Soft Similarity and Soft Cosine Measure: Similarity of Features in Vector Space Model , 2014, Computación y Sistemas.

[2]  Anant Madabhushi,et al.  A Deep Convolutional Neural Network for segmenting and classifying epithelial and stromal regions in histopathological images , 2016, Neurocomputing.

[3]  S. Savin,et al.  Aging effects on the AC motor windings: A correlation between the variation of turn-to-turn capacitance and the PDIV , 2011, 2011 Annual Report Conference on Electrical Insulation and Dielectric Phenomena.

[4]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Adrian E. Raftery,et al.  Bayesian Model Averaging: A Tutorial , 2016 .

[7]  Catalin Buiu,et al.  Development of membrane controllers for mobile robots , 2012, Inf. Sci..

[8]  Michael Pecht,et al.  Health monitoring of solenoid valve electromagnetic coil insulation under thermal deterioration , 2016 .

[9]  Guodong Guo,et al.  Learning from examples in the small sample case: face expression recognition , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Charu C. Aggarwal,et al.  Neural Networks and Deep Learning , 2018, Springer International Publishing.

[11]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Siti Mariyam Hj. Shamsuddin,et al.  Image Segmentation Using Membrane Computing: A Literature Survey , 2016, BIC-TA.

[14]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Lior Rokach,et al.  Ensemble-based classifiers , 2010, Artificial Intelligence Review.

[16]  Juan Zapata-Pérez,et al.  Automatically calibrated occupancy sensors for an ambient assisted living system , 2016, Integr. Comput. Aided Eng..

[17]  D. Roger,et al.  Proposition of a new method for in-service monitoring of the aging of stator winding insulation in AC motors , 2006, IEEE Transactions on Energy Conversion.

[18]  Michael G. Pecht,et al.  Impedance-Based Condition Monitoring for Insulation Systems Used in Low-Voltage Electromagnetic Coils , 2017, IEEE Transactions on Industrial Electronics.

[19]  J. Angel Arul Jothi,et al.  A survey on automated cancer diagnosis from histopathology images , 2017, Artificial Intelligence Review.

[20]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[21]  Nick Schlüter,et al.  Matching the Material of Transparent Objects: The Role of Background Distortions , 2016, i-Perception.

[22]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[23]  Tao Jiang,et al.  Full-automatic computer aided system for stem cell clustering using content-based microscopic image analysis , 2017 .

[24]  Chen Li Content-based microscopic image analysis , 2016 .

[25]  Jürgen Beyerer,et al.  Machine Vision: Automated Visual Inspection: Theory, Practice and Applications , 2015 .

[26]  Debjani Chakraborty,et al.  Transfer learning based classification of optical coherence tomography images with diabetic macular edema and dry age-related macular degeneration. , 2017, Biomedical optics express.

[27]  Richard P. Wildes,et al.  What Do We Understand About Convolutional Networks? , 2018, ArXiv.

[28]  Daniel Díaz-Pernil,et al.  Segmenting images with gradient-based edge detection using Membrane Computing , 2013, Pattern Recognit. Lett..

[29]  Chanan Singh,et al.  Report of Large Motor Reliability Survey of Industrial and Commercial Installations, Part II , 1985, IEEE Transactions on Industry Applications.

[30]  Peter Tavner,et al.  Review of condition monitoring of rotating electrical machines , 2008 .

[31]  Thomas M. Wolbank,et al.  Online insulation condition monitoring of traction machines using inverter induced voltage injection , 2015, IECON 2015 - 41st Annual Conference of the IEEE Industrial Electronics Society.

[32]  M. Dalva,et al.  A survey of faults on induction motors in offshore oil industry, petrochemical industry, gas terminals and oil refineries , 1994, Proceedings of IEEE Petroleum and Chemical Industry Technical Conference (PCIC '94).

[33]  D. Roger,et al.  Turn-to-turn capacitance variations correlated to PDIV for AC motors monitoring , 2013, IEEE Transactions on Dielectrics and Electrical Insulation.

[34]  T. M. Wolbank,et al.  Detection of AC machines insulation health state based on evaluation of switching transients using two current sensors and eigenanalysis-based parameter estimation , 2014, 2014 IEEE Energy Conversion Congress and Exposition (ECCE).

[35]  Germano Lambert-Torres,et al.  Early detection of insulation failures on electric generators through online Frequency Response Analysis , 2016 .

[36]  Bruce G. Batchelor,et al.  Machine Vision for the Inspection of Natural Products , 2013 .

[37]  Ming Zhu,et al.  Geometry based three-dimensional image processing method for electronic cluster eye , 2018, Integr. Comput. Aided Eng..

[38]  Gexiang Zhang,et al.  Multicriteria adaptive differential evolution for global numerical optimization , 2015, Integr. Comput. Aided Eng..

[39]  Tao Jiang,et al.  Design and implementation of membrane controllers for trajectory tracking of nonholonomic wheeled mobile robots , 2015, Integr. Comput. Aided Eng..

[40]  Yanqing Zhang,et al.  Image Thresholding Using Particle Swarm Optimization , 2008, 2008 International Conference on MultiMedia and Information Technology.

[41]  Zoltán Gácsi,et al.  The Application of Digital Image Processing to Materials Science , 2002 .

[42]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[43]  C. Zoeller,et al.  Influence of voltage excitation and current sensors on monitoring of stator winding insulation based on transient current step response , 2015, 2015 IEEE Energy Conversion Congress and Exposition (ECCE).

[44]  Zhi-Hua Zhou,et al.  Ensemble Methods: Foundations and Algorithms , 2012 .

[45]  Marc Ebner,et al.  Color Constancy , 2007, Computer Vision, A Reference Guide.

[46]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Leo Breiman,et al.  Bias, Variance , And Arcing Classifiers , 1996 .

[48]  Report of Large Motor Reliability Survey of Industrial and Commercial Installations, Part I , 1985, IEEE Transactions on Industry Applications.

[49]  Yoshua Bengio,et al.  Generative Adversarial Networks , 2014, ArXiv.

[50]  Chen Li,et al.  Environmental microbiology aided by content-based image analysis , 2015, Pattern Analysis and Applications.

[51]  Gheorghe Paun,et al.  On the Power of Membrane Computing , 1999, J. Univers. Comput. Sci..

[52]  Bettina Hüttenrauch,et al.  Literature review on data augmentation , 2016 .

[53]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[54]  C. L. Philip Chen,et al.  An adaptive regularization method for sparse representation , 2014, Integr. Comput. Aided Eng..

[55]  Steffen Beich,et al.  Digital Video And Hdtv Algorithms And Interfaces , 2016 .

[56]  Chen Li,et al.  Degradation Monitoring of Low-Voltage Electromagnetic Coil Insulation Based on Microscopic Image Analysis , 2018, 2018 Prognostics and System Health Management Conference (PHM-Chongqing).

[57]  Marcin Grzegorzek,et al.  Multi-scale textural feature extraction and particle swarm optimization based model selection for false positive reduction in mammography , 2015, Comput. Medical Imaging Graph..

[58]  Jianwei Zhang,et al.  Recent Advances in Morphological Cell Image Analysis , 2012, Comput. Math. Methods Medicine.

[59]  Togay Ozbakkaloglu,et al.  Influence of concrete age on stress–strain behavior of FRP-confined normal- and high-strength concrete , 2015 .

[60]  F. Perisse,et al.  Robust diagnostics of stator insulation based on high frequency resonances measurements , 2009, IEEE Transactions on Dielectrics and Electrical Insulation.

[61]  D. Roger,et al.  A New Method for AC Machine Turn Insulation Diagnostic Based on High Frequency Resonances , 2007, IEEE Transactions on Dielectrics and Electrical Insulation.

[62]  Thomas M. Wolbank,et al.  Induction Machine Insulation Health State Monitoring Based on Online Switching Transient Exploitation , 2015, IEEE Transactions on Industrial Electronics.

[63]  H. Anton Elementary Linear Algebra , 1970 .

[64]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[65]  Tao Wang,et al.  Fault Diagnosis Models for Electric Locomotive Systems Based on Fuzzy Reasoning Spiking Neural P Systems , 2014, Int. Conf. on Membrane Computing.

[66]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[67]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[68]  Peter J. Bickel,et al.  The Earth Mover's distance is the Mallows distance: some insights from statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[69]  R. Lourie,et al.  The Statistical Mechanics of Financial Markets , 2002 .

[70]  Marian Gheorghe,et al.  Research Frontiers of membrane Computing: Open Problems and Research Topics , 2013, Int. J. Found. Comput. Sci..

[71]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[72]  G. J. Toman,et al.  Aging and service wear of solenoid-operated valves used in safety systems of nuclear power plants: Volume 1, Operating experience and failure identification , 1987 .

[73]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[74]  Chuan Li,et al.  Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[75]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[76]  Hong Peng,et al.  Optimal multi-level thresholding with membrane computing , 2015, Digit. Signal Process..

[77]  Kimiaki Shirahama,et al.  Event retrieval in video archives using rough set theory and partially supervised learning , 2011, Multimedia Tools and Applications.

[78]  Chen Li,et al.  A survey for the applications of content-based microscopic image analysis in microorganism classification domains , 2019, Artificial Intelligence Review.

[79]  Gheorghe Paun,et al.  A quick introduction to membrane computing , 2010, J. Log. Algebraic Methods Program..

[80]  Miguel Á. Carreira-Perpiñán,et al.  Multiscale conditional random fields for image labeling , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[81]  Chen Li,et al.  Environmental microorganism classification using conditional random fields and deep convolutional neural networks , 2018, Pattern Recognit..