Non-Gaussian hyperplane tessellations and robust one-bit compressed sensing

We show that a tessellation generated by a small number of random affine hyperplanes can be used to approximate Euclidean distances between any two points in an arbitrary bounded set $T$, where the random hyperplanes are generated by subgaussian or heavy-tailed normal vectors and uniformly distributed shifts. We derive quantitative bounds on the number of hyperplanes needed for constructing such tessellations in terms of natural metric complexity measures of $T$ and the desired approximation error. Our work extends significantly prior results in this direction, which were restricted to Gaussian hyperplane tessellations of subsets of the Euclidean unit sphere. As an application, we obtain new reconstruction results in memoryless one-bit compressed sensing with non-Gaussian measurement matrices. We show that by quantizing at uniformly distributed thresholds, it is possible to accurately reconstruct low-complexity signals from a small number of one-bit quantized measurements, even if the measurement vectors are drawn from a heavy-tailed distribution. Our reconstruction results are uniform in nature and robust in the presence of pre-quantization noise on the analog measurements as well as adversarial bit corruptions in the quantization process. Moreover we show that if the measurement matrix is subgaussian then accurate recovery can be achieved via a convex program.

[1]  Laurent Jacques,et al.  Robust 1-Bit Compressive Sensing via Binary Stable Embeddings of Sparse Vectors , 2011, IEEE Transactions on Information Theory.

[2]  M. Talagrand,et al.  Probability in Banach spaces , 1991 .

[3]  S. Mendelson,et al.  Compressed sensing under weak moment assumptions , 2014, 1401.2188.

[4]  E. Giné,et al.  Some Limit Theorems for Empirical Processes , 1984 .

[5]  Shahar Mendelson,et al.  Learning without Concentration , 2014, COLT.

[6]  Robert W. Heath,et al.  Capacity Analysis of One-Bit Quantized MIMO Systems With Transmitter Channel State Information , 2014, IEEE Transactions on Signal Processing.

[7]  Yaniv Plan,et al.  One‐Bit Compressed Sensing by Linear Programming , 2011, ArXiv.

[8]  Yaniv Plan,et al.  Dimension Reduction by Random Hyperplane Tessellations , 2014, Discret. Comput. Geom..

[9]  Benjamin Recht,et al.  Near-Optimal Bounds for Binary Embeddings of Arbitrary Sets , 2015, ArXiv.

[10]  Sjoerd Dirksen,et al.  Tail bounds via generic chaining , 2013, ArXiv.

[11]  Richard G. Baraniuk,et al.  1-Bit compressive sensing , 2008, 2008 42nd Annual Conference on Information Sciences and Systems.

[12]  Rayan Saab,et al.  One-Bit Compressive Sensing With Norm Estimation , 2014, IEEE Transactions on Information Theory.

[13]  David L. Neuhoff,et al.  Quantization , 2022, IEEE Trans. Inf. Theory.

[14]  Richard G. Baraniuk,et al.  Exponential Decay of Reconstruction Error From Binary Measurements of Sparse Signals , 2014, IEEE Transactions on Information Theory.

[15]  M. Talagrand Upper and Lower Bounds for Stochastic Processes , 2021, Ergebnisse der Mathematik und ihrer Grenzgebiete. 3. Folge / A Series of Modern Surveys in Mathematics.

[16]  Yaniv Plan,et al.  One-bit compressed sensing with non-Gaussian measurements , 2012, ArXiv.

[17]  Gábor Lugosi,et al.  Concentration Inequalities - A Nonasymptotic Theory of Independence , 2013, Concentration Inequalities.

[18]  Yaniv Plan,et al.  Robust 1-bit Compressed Sensing and Sparse Logistic Regression: A Convex Programming Approach , 2012, IEEE Transactions on Information Theory.

[19]  H. König,et al.  Asymptotic Geometric Analysis , 2015 .

[20]  Holger Rauhut,et al.  One-bit compressed sensing with partial Gaussian circulant matrices , 2017, Information and Inference: A Journal of the IMA.

[21]  Lawrence G. Roberts,et al.  Picture coding using pseudo-random noise , 1962, IRE Trans. Inf. Theory.

[22]  Justin K. Romberg,et al.  Compressive Sensing by Random Convolution , 2009, SIAM J. Imaging Sci..