Hierarchical restricted isometry property for Kronecker product measurements

Hierarchically sparse signals and Kronecker product structured measurements naturally arise in a variety of applications. The simplest example of a hierarchical sparsity structure is two-level $(s,~\sigma )$-hierarchical sparsity which features s-block-sparse signals with s-sparse blocks. For a large class of algorithms recovery guarantees can be derived based on the restricted isometry property (RIP) of the measurement matrix and model-based variants thereof. We show that given two matrices A and B having the standard s-sparse and $\sigma $-sparse RIP their Kronecker product $\mathbf {A}\otimes \mathbf {B}$ has two-level $(s,~\sigma )$-hierarchically sparse RIP (HiRIP). This result can be recursively generalized to signals with multiple hierarchical sparsity levels and measurements with multiple Kronecker product factors. As a corollary we establish the efficient reconstruction of hierarchical sparse signals from Kronecker product measurements using the HiHTP algorithm. We argue that Kronecker product measurement matrices allow to design large practical compressed sensing systems that are deterministically certified to reliably recover signals in a stable fashion. We elaborate on their motivation from the perspective of applications.

[1]  Robert W. Heath,et al.  Channel Estimation for Hybrid Architecture-Based Wideband Millimeter Wave Systems , 2016, IEEE Journal on Selected Areas in Communications.

[2]  Yonina C. Eldar,et al.  Robust Recovery of Signals From a Structured Union of Subspaces , 2008, IEEE Transactions on Information Theory.

[3]  Gerhard Wunder,et al.  Reliable recovery of hierarchically sparse signals and application in machine-type communications , 2016, ArXiv.

[4]  Justin K. Romberg,et al.  Blind Deconvolution Using Convex Programming , 2012, IEEE Transactions on Information Theory.

[5]  Parikshit Shah,et al.  Sketching Sparse Matrices , 2013, ArXiv.

[6]  Axel Flinth,et al.  Reliable Recovery of Hierarchically Sparse Signals for Gaussian and Kronecker Product Measurements , 2020, IEEE Transactions on Signal Processing.

[7]  Ben Adcock,et al.  BREAKING THE COHERENCE BARRIER: A NEW THEORY FOR COMPRESSED SENSING , 2013, Forum of Mathematics, Sigma.

[8]  Xiqi Gao,et al.  Channel Acquisition for Massive MIMO-OFDM With Adjustable Phase Shift Pilots , 2015, IEEE Transactions on Signal Processing.

[9]  Volkan Cevher,et al.  Model-Based Compressive Sensing , 2008, IEEE Transactions on Information Theory.

[10]  Simon Foucart,et al.  Hard Thresholding Pursuit: An Algorithm for Compressive Sensing , 2011, SIAM J. Numer. Anal..

[11]  Gerhard Wunder,et al.  HiHTP: A custom-tailored hierarchical sparse detector for massive MTC , 2017, 2017 51st Asilomar Conference on Signals, Systems, and Computers.

[12]  Marc E. Pfetsch,et al.  The Computational Complexity of the Restricted Isometry Property, the Nullspace Property, and Related Concepts in Compressed Sensing , 2012, IEEE Transactions on Information Theory.

[13]  Babak Hassibi,et al.  On the Reconstruction of Block-Sparse Signals With an Optimal Number of Measurements , 2008, IEEE Transactions on Signal Processing.

[14]  Gerhard Wunder,et al.  Secure massive IoT using hierarchical fast blind deconvolution , 2018, 2018 IEEE Wireless Communications and Networking Conference Workshops (WCNCW).

[15]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[16]  Emmanuel J. Candès,et al.  PhaseLift: Exact and Stable Signal Recovery from Magnitude Measurements via Convex Programming , 2011, ArXiv.

[17]  V. Mehrmann,et al.  Sparse solutions to underdetermined Kronecker product systems , 2009 .

[18]  Holger Rauhut,et al.  A Mathematical Introduction to Compressive Sensing , 2013, Applied and Numerical Harmonic Analysis.

[19]  Thomas Strohmer,et al.  Blind Deconvolution Meets Blind Demixing: Algorithms and Performance Bounds , 2015, IEEE Transactions on Information Theory.

[20]  Gerhard Wunder,et al.  Compressive Random Access Using a Common Overloaded Control Channel , 2015, 2015 IEEE Globecom Workshops (GC Wkshps).

[21]  Yonina C. Eldar,et al.  Collaborative hierarchical sparse modeling , 2010, 2010 44th Annual Conference on Information Sciences and Systems (CISS).

[22]  R. Tibshirani,et al.  A note on the group lasso and a sparse group lasso , 2010, 1001.0736.

[23]  Gerhard Wunder,et al.  Performance of Hierarchical Sparse Detectors for Massive MTC , 2018, ArXiv.

[24]  Holger Boche,et al.  Sparse Signal Processing Concepts for Efficient 5G System Design , 2014, IEEE Access.

[25]  Axel Flinth,et al.  Hierarchical Sparse Channel Estimation for Massive MIMO , 2018, WSA.

[26]  Gerhard Wunder,et al.  Low-Overhead Hierarchically-Sparse Channel Estimation for Multiuser Wideband Massive MIMO , 2018, IEEE Transactions on Wireless Communications.

[27]  Richard G. Baraniuk,et al.  Kronecker product matrices for compressive sensing , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[28]  Dustin G. Mixon,et al.  Certifying the Restricted Isometry Property is Hard , 2012, IEEE Transactions on Information Theory.

[29]  Parikshit Shah,et al.  Sketching Sparse Matrices, Covariances, and Graphs via Tensor Products , 2015, IEEE Transactions on Information Theory.

[30]  Robert W. Heath,et al.  Compressed sensing based multi-user millimeter wave systems: How many measurements are needed? , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).