GPU Accelerated SL0 for Multidimensional Signals

In this paper, we propose a novel GPU-based method for highly parallel compressed sensing of n-dimensional (nD) signals based on the smoothed (SL0) algorithm. We demonstrate the efficiency of our approach by showing several examples of nD tensor reconstructions. Moreover, we also consider the traditional 1D compressed sensing, and compare the results. We show that the multidimensional SL0 algorithm is computationally superior compared to the 1D variant due to the small dictionary sizes per dimension. This allows us to fully utilize the GPU and perform massive batch-wise computations, which is not possible for the 1D compressed sensing using SL0. For our evaluations, we use light field and light field video data sets. We show that we gain more than an order of magnitude speedup for both one-dimensional as well as multidimensional data points compared to a parallel CPU implementation. Finally, we present a theoretical analysis of the SL0 algorithm for nD signals, which generalizes previous work for 1D signals.

[1]  Jared Tanner,et al.  GPU accelerated greedy algorithms for compressed sensing , 2013, Mathematical Programming Computation.

[2]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[3]  Xiaowei Hu,et al.  Multiple-input-multiple-output radar superresolution three-dimensional imaging based on multidimensional smoothed L0 , 2016 .

[4]  J. Tropp,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, Commun. ACM.

[5]  Peng Li,et al.  Compressive Hyperspectral Imaging via Sparse Tensor and Nonlinear Compressed Sensing , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[6]  The American Institute of Electrical Engineers , 1923, Science.

[7]  Dongjian He,et al.  Accelerating 2D orthogonal matching pursuit algorithm on GPU , 2014, The Journal of Supercomputing.

[8]  Jack J. Dongarra,et al.  A Fast Batched Cholesky Factorization on a GPU , 2014, 2014 43rd International Conference on Parallel Processing.

[9]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[10]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[11]  Tinoosh Mohsenin,et al.  Accelerating compressive sensing reconstruction OMP algorithm with CPU, GPU, FPGA and domain specific many-core , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[12]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[13]  Neus Sabater,et al.  Dataset and Pipeline for Multi-view Light-Field Video , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[14]  Stephen J. Wright,et al.  Sparse Reconstruction by Separable Approximation , 2008, IEEE Transactions on Signal Processing.

[15]  Guangdong Feng,et al.  A Tensor Based Method for Missing Traffic Data Completion , 2013 .

[16]  JuttenChristian,et al.  A fast approach for overcomplete sparse decomposition based on smoothed l0 norm , 2009 .

[17]  Anima Anandkumar,et al.  Tensor Contractions with Extended BLAS Kernels on CPU and GPU , 2016, 2016 IEEE 23rd International Conference on High Performance Computing (HiPC).

[18]  Thomas Pock,et al.  Convolutional Networks for Shape from Light Field , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[20]  Michael Elad,et al.  From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images , 2009, SIAM Rev..

[21]  H. Nyquist,et al.  Certain Topics in Telegraph Transmission Theory , 1928, Transactions of the American Institute of Electrical Engineers.

[22]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[23]  Ehsan Miandji,et al.  On Probability of Support Recovery for Orthogonal Matching Pursuit Using Mutual Coherence , 2017, IEEE Signal Processing Letters.

[24]  Mike E. Davies,et al.  Iterative Hard Thresholding for Compressed Sensing , 2008, ArXiv.

[25]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[26]  Christine Guillemot,et al.  Multi-Shot Single Sensor Light Field Camera Using a Color Coded Mask , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[27]  Jonas Unger,et al.  Light Field Video Compression and Real Time Rendering , 2019, Comput. Graph. Forum.

[28]  Paolo Bientinesi,et al.  Design of a High-Performance GEMM-like Tensor–Tensor Multiplication , 2016, ACM Trans. Math. Softw..

[29]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[30]  Jonas Unger,et al.  GPU Accelerated Sparse Representation of Light Fields , 2019, VISIGRAPP.

[31]  Devin A. Matthews,et al.  High-Performance Tensor Contraction without Transposition , 2016, SIAM J. Sci. Comput..

[32]  Jonas Unger,et al.  A Unified Framework for Compression and Compressed Sensing of Light Fields and Light Field Videos , 2019, ACM Trans. Graph..

[33]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[34]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[35]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[36]  Gordon Wetzstein,et al.  Compressive light field photography using overcomplete dictionaries and optimized projections , 2013, ACM Trans. Graph..

[37]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[38]  Gordon Wetzstein,et al.  A Wide-Field-of-View Monocentric Light Field Camera , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).