Robust Image Reconstruction from Multiview Measurements

We propose a novel method to accurately reconstruct a set of images representing a single scene from a few linear multiview measurements. Each observed image is modeled as the sum of a background image and a foreground one. The background image is common to all observed images but undergoes geometric transformations, as the scene is observed from different viewpoints. In this paper, we assume that these geometric transformations are represented by a few parameters, e.g., translation, rotation, affine transformation, etc.. The foreground images differ from one observed image to another, and are used to model possible occlusions of the scene. The proposed reconstruction algorithm estimates jointly the images and the transformation parameters from the available multiview measurements. The ideal solution of this multiview imaging problem minimizes a nonconvex functional, and the reconstruction technique is an alternating descent method built to minimize this functional. The convergence of the proposed algorit...

[1]  Matthias Stuber,et al.  About the performance of multi-dimensional radial self-navigation incorporating compressed sensing for free-breathing coronary MRI , 2012 .

[2]  Benar Fux Svaiter,et al.  Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward–backward splitting, and regularized Gauss–Seidel methods , 2013, Math. Program..

[3]  Michael B. Wakin,et al.  A manifold lifting algorithm for multi-view compressive imaging , 2009, 2009 Picture Coding Symposium.

[4]  Pascal Frossard,et al.  Joint Reconstruction of Multiview Compressed Images , 2012, IEEE Transactions on Image Processing.

[5]  F. Bach,et al.  Optimization with Sparsity-Inducing Penalties (Foundations and Trends(R) in Machine Learning) , 2011 .

[6]  Jean-Yves Audibert.  Optimization for Machine Learning , 1995 .

[7]  Pierre Vandergheynst,et al.  Universal and efficient compressed sensing by spread spectrum and application to realistic Fourier imaging techniques , 2011, EURASIP J. Adv. Signal Process..

[8]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[9]  Pascal Fua,et al.  On benchmarking camera calibration and multi-view stereo for high resolution imagery , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Laurent Jacques,et al.  The PANOPTIC Camera: A Plenoptic Sensor with Real-Time Omnidirectional Capability , 2013, J. Signal Process. Syst..

[11]  Hédy Attouch,et al.  Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Lojasiewicz Inequality , 2008, Math. Oper. Res..

[12]  Pascal Fua,et al.  Efficient large-scale multi-view stereo for ultra high-resolution image sets , 2011, Machine Vision and Applications.

[13]  D. Bertsekas.  Projected Newton methods for optimization problems with simple constraints , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[14]  R. Keys.  Cubic convolution interpolation for digital image processing , 1981 .

[15]  P. Tseng.  Convergence of a Block Coordinate Descent Method for Nondifferentiable Minimization , 2001 .

[16]  Qionghai Dai,et al.  Compressed Multi-view Imaging with Joint Reconstruction , 2011, 2011 Data Compression Conference.

[17]  Heinz H. Bauschke,et al.  Fixed-Point Algorithms for Inverse Problems in Science and Engineering , 2011, Springer Optimization and Its Applications.

[18]  Julien Mairal,et al.  Optimization with Sparsity-Inducing Penalties , 2011, Found. Trends Mach. Learn..

[19]  Pierre Vandergheynst,et al.  Joint reconstruction of misaligned images from incomplete measurements for cardiac MRI , 2013 .

[20]  Yi Ma,et al.  TILT: Transform Invariant Low-Rank Textures , 2010, ACCV 2010.

[21]  Mohamed-Jalal Fadili,et al.  A Generalized Forward-Backward Splitting , 2011, SIAM J. Imaging Sci..

[22]  Rama Chellappa,et al.  Compressive Acquisition of Dynamic Scenes , 2010, ECCV.

[23]  M. Salman Asif,et al.  Motion‐adaptive spatio‐temporal regularization for accelerated dynamic MRI , 2013, Magnetic resonance in medicine.

[24]  Pascal Frossard,et al.  Joint Reconstruction of Multiview Compressed Images , 2013, IEEE Transactions on Image Processing.

[25]  Richard G. Baraniuk,et al.  Joint Sparsity Models for Distributed Compressed Sensing , 2005 .

[26]  M. Unser.  Sampling-50 years after Shannon , 2000, Proceedings of the IEEE.

[27]  E.J. Candes.  Compressive Sampling , 2022 .

[28]  P. Börnert,et al.  Free‐breathing whole‐heart coronary MRA with 3D radial SSFP and self‐navigated image reconstruction , 2005, Magnetic resonance in medicine.

[29]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[30]  John Wright,et al.  RASL: Robust alignment by sparse and low-rank decomposition for linearly correlated images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[31]  Pierre Vandergheynst,et al.  Design and Exploration of Low-Power Analog to Information Conversion Based on Compressed Sensing , 2012, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[32]  Michael B. Wakin,et al.  A geometric approach to multi-view compressive imaging , 2012, EURASIP J. Adv. Signal Process..

[33]  Liangpei Zhang,et al.  A MAP Approach for Joint Motion Estimation, Segmentation, and Super Resolution , 2007, IEEE Transactions on Image Processing.

[34]  Michael Elad,et al.  Fast and Robust Multi-Frame Super-Resolution , 2004, IEEE Transactions on Image Processing.

[35]  Pierre Vandergheynst,et al.  Robust joint reconstruction of misaligned images using semi-parametric dictionaries , 2012, ICML 2012.

[36]  Mark W. Schmidt,et al.  Projected Newton-type methods in machine learning , 2011 .

[37]  Masayuki Tanimoto,et al.  Multiview Imaging and 3DTV , 2007, IEEE Signal Processing Magazine.

[38]  Rayan Saab,et al.  Sparco: A Testing Framework for Sparse Reconstruction , 2007 .

[39]  Enrico Magli,et al.  Distributed Compressed Sensing , 2015 .

[40]  Thomas Maugey,et al.  Disparity-compensated compressed-sensing reconstruction for multiview images , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[41]  Thomas Maugey,et al.  Compressed sensing of multiview images using disparity compensation , 2010, 2010 IEEE International Conference on Image Processing.

[42]  Klamer Schutte,et al.  Robust Fusion of Irregularly Sampled Data Using Adaptive Normalized Convolution , 2006, EURASIP J. Adv. Signal Process..

[43]  Xu Chen,et al.  Joint reconstruction of compressed multi-view images , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[44]  Mohamed-Jalal Fadili,et al.  Monotone operator splitting for optimization problems in sparse recovery , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[45]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[46]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, SIGGRAPH 2005.

[47]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[48]  Qionghai Dai,et al.  Robust joint reconstruction in compressed multi-view imaging , 2012, 2012 Picture Coding Symposium.

[49]  Michael Elad,et al.  Generalizing the Nonlocal-Means to Super-Resolution Reconstruction , 2009, IEEE Transactions on Image Processing.

[50]  Michael Unser,et al.  Fast parametric elastic image registration , 2003, IEEE Trans. Image Process..

[51]  Liang Xiao,et al.  Compressed sensing joint reconstruction for multi-view images , 2010 .

[52]  Stephen J. Wright,et al.  Optimization for Machine Learning , 2013 .

[53]  M. Salman Asif,et al.  Motion-Adaptive Spatio-Temporal Regularization ( MASTeR ) for Accelerated Dynamic MRI , 2012 .

[54]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .