MMV-Net: A Multiple Measurement Vector Network for Multifrequency Electrical Impedance Tomography.

Multi-frequency Electrical Impedance Tomography (mfEIT) is an emerging biomedical imaging modality to reveal frequency-dependent conductivity distributions in biomedical applications. Conventional model-based image reconstruction methods suffer from low spatial resolution, unconstrained frequency correlation and high computational cost. Deep learning has been extensively applied in solving the EIT inverse problem in biomedical and industrial process imaging. However, most existing learning-based approaches deal with the single-frequency setup, which is inefficient and ineffective when extended to address the multi-frequency setup. In this paper, we present a Multiple Measurement Vector (MMV) model based learning algorithm named MMV-Net to solve the mfEIT image reconstruction problem. MMV-Net takes into account the correlations between mfEIT images and unfolds the update steps of the Alternating Direction Method of Multipliers (ADMM) for the MMV problem. The non-linear shrinkage operator associated with the weighted l2,1 regularization term is generalized with a cascade of a Spatial Self-Attention module and a Convolutional Long Short-Term Memory (ConvLSTM) module to capture intraand inter-frequency dependencies. The proposed MMVNet was validated on our Edinburgh mfEIT Dataset and a series of comprehensive experiments. All reconstructed results show superior image quality, convergence performance and noise robustness against the state of the art.

[1]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Manuchehr Soleimani,et al.  Multiple Measurement Vector-Based Complex-Valued Multifrequency ECT , 2020, IEEE Transactions on Instrumentation and Measurement.

[3]  Bangti Jin,et al.  A reconstruction algorithm for electrical impedance tomography based on sparsity regularization , 2012 .

[4]  Mathews Jacob,et al.  MoDL: Model-Based Deep Learning Architecture for Inverse Problems , 2017, IEEE Transactions on Medical Imaging.

[5]  William R B Lionheart,et al.  GREIT: a unified approach to 2D linear EIT reconstruction of lung images , 2009, Physiological measurement.

[6]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[7]  Jiansong Deng,et al.  Shape Reconstruction Using Boolean Operations in Electrical Impedance Tomography , 2020, IEEE Transactions on Medical Imaging.

[8]  Eung Je Woo,et al.  Validation of weighted frequency-difference EIT using a three-dimensional hemisphere model and phantom. , 2011, Physiological measurement.

[9]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[10]  Jin Keun Seo,et al.  Detecting Inclusions in Electrical Impedance Tomography Without Reference Measurements , 2009, SIAM J. Appl. Math..

[11]  Masao Fukushima,et al.  Application of the alternating direction method of multipliers to separable convex programming problems , 1992, Comput. Optim. Appl..

[12]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[13]  S. J. Hamilton,et al.  Deep D-Bar: Real-Time Electrical Impedance Tomography Imaging With Deep Neural Networks , 2017, IEEE Transactions on Medical Imaging.

[14]  Andy Adler,et al.  Electrical Impedance Tomography: Tissue Properties to Image Measures , 2017, IEEE Transactions on Biomedical Engineering.

[15]  Jeffrey A. Fessler,et al.  Image Reconstruction is a New Frontier of Machine Learning , 2018, IEEE Transactions on Medical Imaging.

[16]  Bernard Ghanem,et al.  ISTA-Net: Interpretable Optimization-Inspired Deep Network for Image Compressive Sensing , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[18]  Trac D. Tran,et al.  Abundance Estimation for Bilinear Mixture Models via Joint Sparse and Low-Rank Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Jun Fu,et al.  Dual Attention Network for Scene Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Yonggui Dong,et al.  Multi-Frequency Electromagnetic Tomography for Acute Stroke Detection Using Frequency-Constrained Sparse Bayesian Learning , 2020, IEEE Transactions on Medical Imaging.

[21]  Yongming Huang,et al.  Efficient Multitask Structure-Aware Sparse Bayesian Learning for Frequency-Difference Electrical Impedance Tomography , 2021, IEEE Transactions on Industrial Informatics.

[22]  James Avery,et al.  Multi-frequency electrical impedance tomography and neuroimaging data in stroke patients , 2018, Scientific Data.

[23]  Philip Schniter,et al.  Efficient High-Dimensional Inference in the Multiple Measurement Vector Problem , 2011, IEEE Transactions on Signal Processing.

[24]  Wotao Yin,et al.  Group sparse optimization by alternating direction method , 2013, Optics & Photonics - Optical Engineering + Applications.

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Bhaskar D. Rao,et al.  Sparse solutions to linear inverse problems with multiple measurement vectors , 2005, IEEE Transactions on Signal Processing.

[27]  Lin Yang,et al.  The Frequency Spectral Properties of Electrode-Skin Contact Impedance on Human Head and Its Frequency-Dependent Effects on Frequency-Difference EIT in Stroke Detection from 10Hz to 1MHz , 2017, PloS one.

[28]  Manuchehr Soleimani,et al.  Structural-functional lung imaging using a combined CT-EIT and a Discrete Cosine Transformation reconstruction method , 2016, Scientific Reports.

[29]  Jiabin Jia,et al.  An Image Reconstruction Algorithm for Electrical Impedance Tomography Using Adaptive Group Sparsity Constraint , 2017, IEEE Transactions on Instrumentation and Measurement.

[30]  Dong Liu,et al.  A nonlinear approach to difference imaging in EIT; assessment of the robustness in the presence of modelling errors , 2015 .

[31]  Zhou Chen,et al.  Hybrid Learning-Based Cell Aggregate Imaging With Miniature Electrical Impedance Tomography , 2021, IEEE Transactions on Instrumentation and Measurement.

[32]  James Avery,et al.  Multi-frequency symmetry difference electrical impedance tomography with machine learning for human stroke diagnosis , 2020, Physiological measurement.

[33]  B H Brown,et al.  Electrical impedance tomography (EIT): a review , 2003, Journal of medical engineering & technology.

[34]  Jiabin Jia,et al.  A multi-frequency electrical impedance tomography system for real-time 2D and 3D imaging. , 2017, The Review of scientific instruments.

[35]  Yimin D. Zhang,et al.  Image Reconstruction in Electrical Impedance Tomography Based on Structure-Aware Sparse Bayesian Learning , 2018, IEEE Transactions on Medical Imaging.

[36]  Masahiro Takei,et al.  Image Reconstruction Based on Convolutional Neural Network for Electrical Resistance Tomography , 2019, IEEE Sensors Journal.

[37]  Kai Sun,et al.  A Statistical Shape-Constrained Reconstruction Framework for Electrical Impedance Tomography , 2019, IEEE Transactions on Medical Imaging.

[38]  Yonggui Dong,et al.  FISTA-Net: Learning a Fast Iterative Shrinkage Thresholding Network for Inverse Problems in Imaging , 2021, IEEE Transactions on Medical Imaging.

[39]  Zongben Xu,et al.  ADMM-CSNet: A Deep Learning Approach for Image Compressive Sensing , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Feng Zhang,et al.  Group sparse recovery in impulsive noise via alternating direction method of multipliers , 2018, Applied and Computational Harmonic Analysis.

[41]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[42]  Dong Liu,et al.  Dominant-Current Deep Learning Scheme for Electrical Impedance Tomography , 2019, IEEE Transactions on Biomedical Engineering.

[43]  B H Brown,et al.  The Sheffield data collection system. , 1987, Clinical physics and physiological measurement : an official journal of the Hospital Physicists' Association, Deutsche Gesellschaft fur Medizinische Physik and the European Federation of Organisations for Medical Physics.

[44]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.