Multi-Array Camera Disparity Enhancement

Multi-array camera systems have greater potential for 3-D depth-based application development compared with stereo camera systems. However, there are very few research results on multi-array-based disparity enhancement, extending standard stereo matchings to multi-array systems. In this paper, we propose to alternately use local and global fusion of multi-array disparities to maximize the disparity enhancement in array camera systems. We propose a new cascade regularization based approach, which can restore diagonal structures better than conventional techniques. The detailed analysis and experimental results verify that the cascade approach better regularizes the diagonal variations and in turn yields better image enhancement. We adapt total variation for regularization to the multi-array camera systems in order to globally combine multiple disparity estimates. A local multiple cross-filling algorithm is proposed to achieve cross consistency between array disparity estimates by effectively filling the mismatches. Experimental results show that the proposed multi-array disparity enhancement algorithm can improve the accuracy of the initial array disparity estimates up to 65% while alleviating memory limitation.

[1]  Takeo Kanade,et al.  A Multiple-Baseline Stereo , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Jitendra Malik,et al.  Depth from Combining Defocus and Correspondence Using Light-Field Cameras , 2013, 2013 IEEE International Conference on Computer Vision.

[3]  Shree K. Nayar,et al.  Multiple view image denoising , 2009, CVPR.

[4]  Wotao Yin,et al.  Bregman Iterative Algorithms for (cid:2) 1 -Minimization with Applications to Compressed Sensing ∗ , 2008 .

[5]  Mario Bertero,et al.  Introduction to Inverse Problems in Imaging , 1998 .

[6]  Minh N. Do,et al.  Symmetric multi-view stereo reconstruction from planar camera arrays , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Xing Mei,et al.  On building an accurate stereo matching system on graphics hardware , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[9]  Margrit Gelautz,et al.  Local stereo matching using geodesic support weights , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[10]  Gene H. Golub,et al.  A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration , 1999, SIAM J. Sci. Comput..

[11]  Stanley Osher,et al.  A split Bregman method for non-negative sparsity penalized least squares with applications to hyperspectral demixing , 2010, 2010 IEEE International Conference on Image Processing.

[12]  Truong Q. Nguyen,et al.  An Augmented Lagrangian Method for Total Variation Video Restoration , 2011, IEEE Transactions on Image Processing.

[13]  Junfeng Yang,et al.  An Efficient TVL1 Algorithm for Deblurring Multichannel Images Corrupted by Impulsive Noise , 2009, SIAM J. Sci. Comput..

[14]  Gauthier Lafruit,et al.  Anisotropic local high-confidence voting for accurate stereo correspondence , 2008, Electronic Imaging.

[15]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Sven Wanner,et al.  Globally consistent depth labeling of 4D light fields , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  José M. Bioucas-Dias,et al.  Fast Image Recovery Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[18]  Richard Szeliski,et al.  Noise Estimation from a Single Image , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[19]  C. Vogel.  Computational Methods for Inverse Problems , 1987 .

[20]  Truong Q. Nguyen,et al.  Local Disparity Estimation With Three-Moded Cross Census and Advanced Support Weight , 2013, IEEE Transactions on Multimedia.

[21]  Takeshi Naemura,et al.  Generation of a disparity panorama using a 3-camera capturing system , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[22]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Amir Beck,et al.  On the Solution of the Tikhonov Regularization of the Total Least Squares Problem , 2006, SIAM J. Optim..

[24]  Yaron Caspi,et al.  Under the supervision of , 2003 .

[25]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, SIGGRAPH 2005.

[26]  Carsten Rother,et al.  Fast cost-volume filtering for visual correspondence and beyond , 2011, CVPR 2011.

[27]  Yael Pritch,et al.  Scene reconstruction from high spatio-angular resolution light fields , 2013, ACM Trans. Graph..

[28]  Gérard G. Medioni,et al.  3-D Surface Description from Binocular Stereo , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[30]  Sven Wanner,et al.  Datasets and Benchmarks for Densely Sampled 4D Light Fields , 2013, VMV.

[31]  Gauthier Lafruit,et al.  Cross-Based Local Stereo Matching Using Orthogonal Integral Images , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Pascal Fua,et al.  A parallel stereo algorithm that produces dense depth maps and preserves image features , 1993, Machine Vision and Applications.

[33]  Per Christian Hansen,et al.  Analysis of Discrete Ill-Posed Problems by Means of the L-Curve , 1992, SIAM Rev..