ECT-LSTM-RNN: An Electrical Capacitance Tomography Model-Based Long Short-Term Memory Recurrent Neural Networks for Conductive Materials

Image reconstruction for industrial applications based on Electrical Capacitance Tomography (ECT) has been broadly applied. The goal of image reconstruction based ECT is to locate the distribution of permittivity for the dielectric substances along the cross-section based on the collected capacitance data. In the ECT-based image reconstruction process: (1) the relationship between capacitance measurements and permittivity distribution is nonlinear, (2) the capacitance measurements collected during image reconstruction are inadequate due to the limited number of electrodes, and (3) the reconstruction process is subject to noise leading to an ill-posed problem. Thence, constructing an accurate algorithm for real images is critical to overcoming such restrictions. This paper presents novel image reconstruction methods using Deep Learning for solving the forward and inverse problems of the ECT system for generating high-quality images of conductive materials in the Lost Foam Casting (LFC) process. Here, Long Short-Term Memory Recurrent Neural Network (LSTM-RNN) models were implemented to predict the distribution of metal filling for the LFC process-based ECT. The recurrent connection and the gating mechanism of the LSTM is capable of extracting the contextual information that is repeatedly passing through the neural network while filtering out the noise caused by adverse factors. Experimental results showed that the presented ECT-LSTM-RNN model is highly reliable for industrial applications and can be utilized for other manufacturing processes.

[1]  W. Deabes,et al.  A nonlinear fuzzy assisted image reconstruction algorithm for electrical capacitance tomography. , 2010, ISA transactions.

[2]  M. Neumayer,et al.  Current Reconstruction Algorithms in Electrical Capacitance Tomography , 2011 .

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  M Meribout,et al.  Electronic hardware design of electrical capacitance tomography systems , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[5]  Andreas Hauptmann,et al.  Beltrami-net: domain-independent deep D-bar learning for absolute imaging with electrical impedance tomography (a-EIT) , 2018, Physiological measurement.

[6]  Fatih Demir DeepCoroNet: A deep LSTM approach for automated detection of COVID-19 cases from chest X-ray images , 2021, Applied Soft Computing.

[7]  Jan Hendrik Witte,et al.  Deep Learning for Finance: Deep Portfolios , 2016 .

[8]  Hesham H. Amin,et al.  Optimized fuzzy image reconstruction algorithm for ECT systems , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[9]  Lihui Peng,et al.  An Autoencoder-Based Image Reconstruction for Electrical Capacitance Tomography , 2018, IEEE Sensors Journal.

[10]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..

[11]  Kheir Eddine Bouazza,et al.  Application of Electrical Capacitance Tomography for Imaging Conductive Materials in Industrial Processes , 2019, J. Sensors.

[12]  Mohamed A. Abdelrahman,et al.  Shape reconstruction method for imaging conductive materials in Electrical Capacitance Tomography , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[13]  Britt M. E. Moldestad,et al.  Investigation of Bubbling Behavior in Deep Fluidized Beds at Different Gas Velocities using Electrical Capacitance Tomography , 2019, Industrial & Engineering Chemistry Research.

[14]  Zenghui Wang,et al.  Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review , 2017, Neural Computation.

[15]  D. Caulk Analysis of Mold Filling in Lost Foam Casting of Aluminum: Part II-Example Applications , 2009 .

[16]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[17]  R. Maddahian,et al.  A New Algorithm for Image Reconstruction of Electrical Capacitance Tomography Based on Inverse Heat Conduction Problems , 2016, IEEE Sensors Journal.

[18]  Q. Marashdeh,et al.  Nonlinear forward problem solution for electrical capacitance tomography using feed-forward neural network , 2006, IEEE Sensors Journal.

[19]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[20]  W. A. Deabes,et al.  Solution of the Forward Problem of Electric Capacitance Tomography of Conductive Materials , .

[21]  Begum Sertyesilisik,et al.  Deep learning approach's effectiveness on sustainability improvement in the UK construction industry , 2012 .

[22]  A V Korjenevsky,et al.  Electric field tomography for contactless imaging of resistivity in biomedical applications , 2004, Physiological measurement.

[23]  M.A. Abdelrahman,et al.  A confidence prediction system for metal fill visualization using Electrical Capacitance Tomography , 2009, 2009 41st Southeastern Symposium on System Theory.

[24]  Shi Liu,et al.  Image reconstruction algorithm based on the extended regularised total least squares method for electrical capacitance tomography , 2008 .

[25]  R. Harikumar,et al.  Electrical Impedance Tomography (EIT) and Its Medical Applications: A Review , 2013 .

[26]  Jianwei Li,et al.  An Image Reconstruction Algorithm Based on RBF Neural Network for Electrical Capacitance Tomography , 2012, 2012 Sixth International Conference on Electromagnetic Field Problems and Applications.

[27]  Manuchehr Soleimani,et al.  A novel metal flow imaging using electrical capacitance tomography , 2017 .

[28]  Z. Zeeshan,et al.  Fast algorithm for image reconstruction in adaptive electrical capacitance tomography , 2016, 2016 IEEE SENSORS.

[29]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[30]  Jeffrey A. Fessler,et al.  Forward-Projection Architecture for Fast Iterative Image Reconstruction in X-Ray CT , 2012, IEEE Transactions on Signal Processing.

[31]  Masahiro Takei,et al.  Image Reconstruction Based on Convolutional Neural Network for Electrical Resistance Tomography , 2019, IEEE Sensors Journal.

[32]  Ken Primrose,et al.  Super-sensing technology: industrial applications and future challenges of electrical tomography , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[33]  W. D. Griffiths,et al.  Instability of the Liquid Metal–Pattern Interface in the Lost Foam Casting of Aluminum Alloys , 2016, Metallurgical and Materials Transactions A.

[34]  JOHNSON MATTHEY,et al.  Industrial Tomography : Systems and Applications ” , 2016 .

[35]  Mohamed A. Abdelrahman,et al.  Analysis, design and application of a capacitance measurement circuit with wide operating frequency range , 2008, 2008 IEEE International Conference on Control Applications.

[36]  Jun Xiao,et al.  Deep Learning Image Reconstruction Simulation for Electromagnetic Tomography , 2018, IEEE Sensors Journal.

[37]  Jing Lei,et al.  Deep Learning-Based Inversion Method for Imaging Problems in Electrical Capacitance Tomography , 2018, IEEE Transactions on Instrumentation and Measurement.

[38]  W. A. Deabes,et al.  Fuzzy mathematical modeling for reconstructing images in ECT of manufacturing processes , 2009, 2009 International Conference on Computer Engineering & Systems.

[39]  Microwave Tomography With LSTM-Based Processing of the Scattered Field , 2021, IEEE Open Journal of Antennas and Propagation.

[40]  Michael Elad,et al.  Spatially-Adaptive Reconstruction in Computed Tomography Using Neural Networks , 2013, IEEE Transactions on Medical Imaging.

[41]  Haigang Wang,et al.  Image Reconstruction for Electrical Capacitance Tomography Based on Sparse Representation , 2015, IEEE Transactions on Instrumentation and Measurement.

[42]  Jacek Kucharski,et al.  Fuzzy inference for two-phase gas-liquid flow type evaluation based on raw 3D ECT measurement data , 2017 .

[43]  Dat Q. Tran,et al.  A CNN-LSTM Architecture for Detection of Intracranial Hemorrhage on CT Scans , 2020, medRxiv.

[44]  Chao-Han Huck Yang,et al.  Attention Based Bidirectional Convolutional LSTM for High-Resolution Radio Tomographic Imaging , 2021, IEEE Transactions on Circuits and Systems II: Express Briefs.

[45]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[46]  D. W. Zhang,et al.  Application of Bi-directional Long Short-Term Memory Recurrent Neural Network for Seismic Impedance Inversion , 2019, 81st EAGE Conference and Exhibition 2019.

[47]  A Wide frequency range circuit for measuring mutual capacitance with application to monitoring of metal fill profile , 2008, IEEE SoutheastCon 2008.

[48]  Ø. Isaksen,et al.  A review of reconstruction techniques for capacitance tomography , 1996 .

[49]  Yan Han,et al.  Electrical resistance tomography with conditional generative adversarial networks , 2020, Measurement Science and Technology.

[50]  Xu Qing,et al.  Overview on Image Reconstruction Algorithms for Electrical Capacitance Tomography , 2018, 2018 37th Chinese Control Conference (CCC).

[51]  Wuqiang Yang,et al.  Image reconstruction by nonlinear Landweber iteration for complicated distributions , 2008 .

[52]  Noorbakhsh Amiri Golilarz,et al.  Early Detection of Covid-19 Disease using Computed Tomography Images and Optimized CNN-LSTM , 2020, 2020 17th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP).

[53]  Lifeng Zhang,et al.  Reconstruction method of electrical capacitance tomography based on wavelet fusion , 2018 .

[54]  Andrzej Romanowski,et al.  Application of electrical capacitance tomography and artificial neural networks to rapid estimation of cylindrical shape parameters of industrial flow structure , 2016 .

[56]  Ruzairi Abdul Rahim,et al.  Electrical capacitance tomography: a review on portable ECT system and hardware design , 2016 .

[57]  Tomasz Rymarczyk,et al.  A Non-Destructive System Based on Electrical Tomography and Machine Learning to Analyze the Moisture of Buildings , 2018, Sensors.

[58]  Amy Loutfi,et al.  A review of unsupervised feature learning and deep learning for time-series modeling , 2014, Pattern Recognit. Lett..

[59]  Andrew W. Senior,et al.  Long short-term memory recurrent neural network architectures for large scale acoustic modeling , 2014, INTERSPEECH.

[60]  Yang Lu,et al.  Industry 4.0: A survey on technologies, applications and open research issues , 2017, J. Ind. Inf. Integr..

[61]  Fazlul Rahman Mohd Yunus,et al.  A Review on Electrical Capacitance Tomography Sensor Development , 2015 .

[62]  Kyung Youn Kim,et al.  Novel Iterative Image Reconstruction Algorithm for Electrical Capacitance Tomography: Directional Algebraic Reconstruction Technique , 2006, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..