Exponential Signal Reconstruction With Deep Hankel Matrix Factorization

Exponential function is a basic form of temporal signals, and how to fast acquire this signal is one of the fundamental problems and frontiers in signal processing. To achieve this goal, partial data may be acquired but result in severe artifacts in its spectrum, which is the Fourier transform of exponentials. Thus, reliable spectrum reconstruction is highly expected in the fast data acquisition in many applications, such as chemistry, biology, and medical imaging. In this work, we propose a deep learning method whose neural network structure is designed by imitating the iterative process in the model-based state-of-the-art exponentials' reconstruction method with the low-rank Hankel matrix factorization. With the experiments on synthetic data and realistic biological magnetic resonance signals, we demonstrate that the new method yields much lower reconstruction errors and preserves the low-intensity signals much better than compared methods.

[1]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[2]  Ivan Markovsky,et al.  Structured Low-Rank Approximation with Missing Data , 2013, SIAM J. Matrix Anal. Appl..

[3]  Di Guo,et al.  Reconstruction of Self-Sparse 2D NMR Spectra from Undersampled Data in the Indirect Dimension† , 2011, Sensors.

[4]  Yuxin Chen,et al.  Robust Spectral Compressed Sensing via Structured Matrix Completion , 2013, IEEE Transactions on Information Theory.

[5]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[6]  Yonina C. Eldar,et al.  Deep Unfolded Robust PCA with Application to Clutter Suppression in Ultrasound , 2018, bioRxiv.

[7]  Pierre Comon,et al.  Hankel Low-Rank Matrix Completion: Performance of the Nuclear Norm Relaxation , 2016, IEEE Journal of Selected Topics in Signal Processing.

[8]  Guillermo Sapiro,et al.  Learning Efficient Sparse and Low Rank Models , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Akira Hirose,et al.  Generalization Characteristics of Complex-Valued Feedforward Neural Networks in Relation to Signal Coherence , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[10]  L. De Lathauwer,et al.  Exponential data fitting using multilinear algebra: the decimative case , 2009 .

[11]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[12]  Bernard Ghanem,et al.  ISTA-Net: Interpretable Optimization-Inspired Deep Network for Image Compressive Sensing , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  George Trigeorgis,et al.  A Deep Matrix Factorization Method for Learning Attribute Representations , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Di Guo,et al.  Hankel Matrix Nuclear Norm Regularized Tensor Completion for $N$-dimensional Exponential Signals , 2016, IEEE Transactions on Signal Processing.

[15]  Nathan Srebro,et al.  Implicit Regularization in Matrix Factorization , 2017, 2018 Information Theory and Applications Workshop (ITA).

[16]  Liansheng Wang,et al.  Image reconstruction with low-rankness and self-consistency of k-space data in parallel MRI , 2019, Medical Image Anal..

[17]  Michael Elad,et al.  Shape from moments - an estimation theory perspective , 2004, IEEE Transactions on Signal Processing.

[18]  Nathan Srebro,et al.  Learning with matrix factorizations , 2004 .

[19]  Vladislav Yu Orekhov,et al.  Removal of a time barrier for high-resolution multidimensional NMR spectroscopy , 2006, Nature Methods.

[20]  Weiyu Xu,et al.  Robust recovery of complex exponential signals from random Gaussian projections via low rank Hankel matrix reconstruction , 2015, Applied and computational harmonic analysis.

[21]  Xiaobo Qu,et al.  Review and Prospect: Deep Learning in Nuclear Magnetic Resonance Spectroscopy , 2020, Chemistry.

[22]  Jian-Feng Cai,et al.  Accelerated Structured Alternating Projections for Robust Spectrally Sparse Signal Recovery , 2021, IEEE Transactions on Signal Processing.

[23]  Paul Tseng,et al.  Hankel Matrix Rank Minimization with Applications to System Identification and Realization , 2013, SIAM J. Matrix Anal. Appl..

[24]  Microsoft Word-pISTA-SENSE-ResNet-SPL_V2.2.docx , 2019 .

[25]  Di Guo,et al.  A Fast Self-Learning Subspace Reconstruction Method for Non-Uniformly Sampled Nuclear Magnetic Resonance Spectroscopy , 2020, Applied Sciences.

[26]  Pablo A. Parrilo,et al.  The Convex Geometry of Linear Inverse Problems , 2010, Foundations of Computational Mathematics.

[27]  Zhong Chen,et al.  Vandermonde Factorization of Hankel Matrix for Complex Exponential Signal Recovery—Application in Fast NMR Spectroscopy , 2018, IEEE Transactions on Signal Processing.

[28]  L. Gladden,et al.  Fast multidimensional NMR spectroscopy using compressed sensing. , 2011, Angewandte Chemie.

[29]  Zongben Xu,et al.  ADMM-CSNet: A Deep Learning Approach for Image Compressive Sensing , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Yonina C. Eldar,et al.  Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing , 2021, IEEE Signal Processing Magazine.

[31]  S. Grzesiek,et al.  NMRPipe: A multidimensional spectral processing system based on UNIX pipes , 1995, Journal of biomolecular NMR.

[32]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  S. Hyberts,et al.  Poisson-gap sampling and forward maximum entropy reconstruction for enhancing the resolution and sensitivity of protein NMR data. , 2010, Journal of the American Chemical Society.

[34]  Woonghee Lee,et al.  NMRFAM-SPARKY: enhanced software for biomolecular NMR spectroscopy , 2014, Bioinform..

[35]  Sanjeev Arora,et al.  Implicit Regularization in Deep Matrix Factorization , 2019, NeurIPS.

[36]  Di Guo,et al.  Accelerated Nuclear Magnetic Resonance Spectroscopy with Deep Learning , 2019, Angewandte Chemie.

[37]  Zhong Chen,et al.  Low Rank Enhanced Matrix Recovery of Hybrid Time and Frequency Data in Fast Magnetic Resonance Spectroscopy , 2018, IEEE Transactions on Biomedical Engineering.

[38]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[39]  Zhiying Jiang,et al.  Knowledge-Driven Deep Unrolling for Robust Image Layer Separation , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[40]  Justin K. Romberg,et al.  Beyond Nyquist: Efficient Sampling of Sparse Bandlimited Signals , 2009, IEEE Transactions on Information Theory.

[41]  P. Koehla,et al.  Linear prediction spectral analysis of NMR data , 1999 .

[42]  Nikos D. Sidiropoulos,et al.  Tensor Algebra and Multidimensional Harmonic Retrieval in Signal Processing for MIMO Radar , 2010, IEEE Transactions on Signal Processing.

[43]  X. Qu,et al.  COMPRESSED SENSING FOR SPARSE MAGNETIC RESONANCE SPECTROSCOPY , 2009 .

[44]  Review and Prospect: NMR Spectroscopy Denoising & Reconstruction with Low Rank Hankel Matrices and Tensors. , 2020, Magnetic resonance in chemistry : MRC.

[45]  Ivan Markovsky,et al.  Recent progress on variable projection methods for structured low-rank approximation , 2014, Signal Process..

[46]  Thierry Blu,et al.  Sampling signals with finite rate of innovation , 2002, IEEE Trans. Signal Process..

[47]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[48]  Jong Chul Ye,et al.  A General Framework for Compressed Sensing and Parallel MRI Using Annihilating Filter Based Low-Rank Hankel Matrix , 2015, IEEE Transactions on Computational Imaging.

[49]  Thomas Kailath,et al.  ESPRIT-estimation of signal parameters via rotational invariance techniques , 1989, IEEE Trans. Acoust. Speech Signal Process..

[50]  Jian-Feng Cai,et al.  Accelerated NMR spectroscopy with low-rank reconstruction. , 2015, Angewandte Chemie.

[51]  Zhang Yi,et al.  Connections Between Nuclear-Norm and Frobenius-Norm-Based Representations , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[52]  V. Orekhov,et al.  Accelerated NMR spectroscopy by using compressed sensing. , 2011, Angewandte Chemie.

[53]  Qian Du,et al.  Hyperspectral Unmixing Using Sparsity-Constrained Deep Nonnegative Matrix Factorization With Total Variation , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[54]  Minh N. Do,et al.  Denoising MR Spectroscopic Imaging Data With Low-Rank Approximations , 2013, IEEE Transactions on Biomedical Engineering.

[55]  Di Guo,et al.  A Fast Low Rank Hankel Matrix Factorization Reconstruction Method for Non-Uniformly Sampled Magnetic Resonance Spectroscopy , 2017, IEEE Access.

[56]  Lei Huang,et al.  PUMA: An Improved Realization of MODE for DOA Estimation , 2017, IEEE Transactions on Aerospace and Electronic Systems.