A new super-resolution method for monochrome camera array imaging

Multi-view super-resolution refers to the process of reconstructing a high-resolution image from a set of low-resolution images captured from different viewpoints typically by different cameras. These multi-view images are usually obtained by an array of the same color cameras. However, the color cameras have color filter array to acquire color information, which reduces the quality of obtained images. To avoid color camera, and obtain higher resolution color images, we do research on a camera array which consists of interlaced different monochrome cameras and propose a new super-resolution method based on the camera array. Given that MVSR is an ill-posed problem and is typically computationally costly, we super-resolve multi-view monochrome images of the original scene via solve a regularization optimization problem consisting of a data-fitting term and three regularization terms on image, blur and cross-channel priors. The resulting optimization problems with respect to the desired image and with respect to the unknown blur are efficiently addressed by the alternating direction method of multiplier. Corresponding experimental results, conducted on a series of datasets captured by our own camera array system, demonstrate the effectiveness of the proposed method.

[1]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[2]  Tania Stathaki,et al.  Image Fusion: Algorithms and Applications , 2008 .

[3]  Hua Huang,et al.  No-reference image quality assessment based on spatial and spectral entropies , 2014, Signal Process. Image Commun..

[4]  Yoram Singer,et al.  Efficient projections onto the l1-ball for learning in high dimensions , 2008, ICML '08.

[5]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[6]  Peyman Milanfar,et al.  Blind Deconvolution Using Alternating Maximum a Posteriori Estimation with Heavy-Tailed Priors , 2013, CAIP.

[7]  Shree K. Nayar,et al.  PiCam , 2013, ACM Trans. Graph..

[8]  B. Mercier,et al.  A dual algorithm for the solution of nonlinear variational problems via finite element approximation , 1976 .

[9]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[10]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, SIGGRAPH 2005.

[11]  Mário A. T. Figueiredo,et al.  Deconvolving Images With Unknown Boundaries Using the Alternating Direction Method of Multipliers , 2012, IEEE Transactions on Image Processing.

[12]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[13]  Jun Fan,et al.  Super-resolving blurry multiframe images through multiframe blind deblurring using ADMM , 2016, Multimedia Tools and Applications.

[14]  Yue Wu,et al.  A novel method for high dynamic range with binocular cameras , 2018, International Conference on Digital Image Processing.

[15]  José M. Bioucas-Dias,et al.  Fast Image Recovery Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[16]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[17]  Andrew R Harvey,et al.  Super-resolution imaging using a camera array. , 2014, Optics letters.

[18]  Wolfgang Heidrich,et al.  High-quality computational imaging through simple lenses , 2013, TOGS.

[19]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[20]  Takeshi Naemura,et al.  Super-Resolved Free-Viewpoint Image Synthesis Based on View-Dependent Depth Estimation , 2012, IPSJ Trans. Comput. Vis. Appl..