Videoscope-based inspection of turbofan engine blades using convolutional neural networks and image processing

A typical aircraft engine consists of fans, compressors, turbines, and so on, and each is made of multiple layers of blades. Discovering the site of damages among the large number of blades during aircraft engine maintenance is quite important. However, it is impossible to look directly into the engine unless it is disassembled. For this reason, optical equipment such as a videoscope is used to visually inspect the blades of an engine through inspection holes. The videoscope inspection method has some obvious drawbacks such as the long-time attention on microscopic video feed and high labor intensity. In this research, we developed a damage recognition algorithm using convolutional neural networks and some image-processing techniques related to feature point extraction and matching in order to improve the videoscope inspection method. The image-processing techniques were mainly used for the preprocessing of the videoscope images, from which a suspected damaged region is selected after the preprocessing. The suspected region is finally classified as damaged or normal by the pre-trained convolutional neural networks. We trained the convolutional neural networks 2000 times by using data from 380 images and calculated the classification accuracy using data from 40 images. After repeating the above procedure 50 times with the data randomly divided into training and test groups, an average classification accuracy of 95.2% for each image and a damage detectability of 100% in video were obtained. For verification of the proposed approach, the convolutional neural network part was compared with the traditional neural network, and the preprocessing was compared with the region proposal network of the faster region–based convolutional neural networks. In addition, we developed a platform based on the developed damage recognition algorithm and conducted field tests with a videoscope for a real engine. The damage detection AI platform was successfully applied to the inspection video probed in an in-service engine.

[1]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[2]  W D Zhu,et al.  Structural Damage Detection Using Changes in Natural Frequencies: Theory and Applications , 2011 .

[3]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[4]  Spilios D. Fassois,et al.  Vibration-based multi-site damage precise localization via the Functional Model Based Method , 2017 .

[5]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[6]  Vasilis K. Dertimanis,et al.  Vibration-based experimental damage detection of a small-scale wind turbine blade , 2017 .

[7]  Liton Chandra Paul,et al.  Face recognition using Principal Component Analysis method , 2012 .

[8]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[9]  Li Cheng,et al.  Damage detection based on sparse virtual element boundary measurement using metal-core piezoelectric fiber , 2018 .

[10]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[11]  Emil Manoach.  Vibration based methods for damage detection in structures , 2015 .

[12]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Charles R. Farrar,et al.  A summary review of vibration-based damage identification methods , 1998 .

[14]  Jian Li,et al.  Damage Detection with Streamlined Structural Health Monitoring Data , 2015, Sensors.

[15]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Richard I. Hartley,et al.  Optimised KD-trees for fast image descriptor matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Oral Büyüköztürk,et al.  Autonomous Structural Visual Inspection Using Region‐Based Deep Learning for Detecting Multiple Damage Types , 2018, Comput. Aided Civ. Infrastructure Eng..