Joint low-rank and sparse light field modelling for dense multiview data compression

The effective representation of the structures in the multiview images is an important problem that arises in visual sensor networks. This paper presents a novel recovery scheme from compressive samples which exploit local and non-local correlated structures in dense multiview images. The recovery model casts into convex minimization framework which penalizes the sparse and low-rank constraints on the data. The sparsity constraint models the correlations among pixels in a single image whereas the global correlations across images are modelled with the low-rank prior. Simulation results demonstrate that our approach achieves better reconstruct quality in comparison with the state-of-the-art reconstruction schemes.

[1]  Pascal Frossard,et al.  Joint Reconstruction of Multiview Compressed Images , 2012, IEEE Transactions on Image Processing.

[2]  Pierre Vandergheynst,et al.  Light field compressive sensing in camera arrays , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[4]  Justin K. Romberg,et al.  Compressive Sensing by Random Convolution , 2009, SIAM J. Imaging Sci..

[5]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[6]  E.J. Candes Compressive Sampling , 2022 .

[7]  Heung-Yeung Shum,et al.  Image-Based Rendering and Synthesis , 2007, IEEE Signal Processing Magazine.

[8]  Sedi-Sap CEA-Saclay MONOTONE OPERATOR SPLITTING FOR OPTIMIZATION PROBLEMS IN SPARSE RECOVERY , 2009 .

[9]  Stephen P. Boyd,et al.  A rank minimization heuristic with application to minimum order system approximation , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[10]  Laurent Jacques,et al.  CMOS compressed imaging by Random Convolution , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  Pascal Frossard,et al.  Joint Reconstruction of Multiview Compressed Images , 2013, IEEE Transactions on Image Processing.

[12]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[13]  Michael B. Wakin,et al.  A geometric approach to multi-view compressive imaging , 2012, EURASIP J. Adv. Signal Process..

[14]  E. Candès,et al.  Compressed sensing and robust recovery of low rank matrices , 2008, 2008 42nd Asilomar Conference on Signals, Systems and Computers.