Iterative colour correction of multicamera systems using corresponding feature points

Multiview images captured by multicamera systems are generally not uniform in colour domain. In this paper, we propose a novel colour correction method of multicamera systems that can (i) be applied to not only dense multicamera system, but also sparse multicamera configuration and (ii) obtain an average colour pattern among all cameras. Our proposed colour correction method starts from any camera on the array sequentially, following a certain path, for pairs of cameras, until it reaches the starting point and triggers several iterations. The iteration stops when the correction applied to the images becomes small enough. We propose to calculate the colour correction transformation based on energy minimisation using a dynamic programming of a nonlinearly weighted Gaussian-based kernel density function of geometrically corresponding feature points, obtained by the modified scale invariant feature transformation (SIFT) method, from several time instances and their Gaussian-filtered images. This approach guarantees the convergence of the iteration procedure without any visible colour distortion. The colour correction is done for each colour channel independently. The process is entirely automatic, after estimation of the parameters through the algorithm. Experimental results show that the proposed iteration-based algorithm can colour-correct the dense/sparse multicamera system. The correction is always converged with average colour intensity among viewpoint, and out-performs the conventional method.

[1]  David W. Scott,et al.  Multivariate Density Estimation: Theory, Practice, and Visualization , 1992, Wiley Series in Probability and Statistics.

[2]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[3]  Sunil Arya,et al.  An optimal algorithm for approximate nearest neighbor searching fixed dimensions , 1998, JACM.

[4]  Toshiaki Fujii,et al.  The Optimization of Distributed Processing for Arbitrary View Generation in Camera Sensor Networks , 2004 .

[5]  Marc Pollefeys,et al.  Robust Radiometric Calibration and Vignetting Correction , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Wojciech Matusik,et al.  3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes , 2004, ACM Trans. Graph..

[7]  Kenji Yamamoto,et al.  Color correction for multi-view video using energy minimization of view networks , 2008, Int. J. Autom. Comput..

[8]  Masayuki Tanimoto Overview of free viewpoint television , 2006, Signal Process. Image Commun..

[9]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Toshiaki Fujii,et al.  Color correction for multi-camera system by using correspondences , 2006, SIGGRAPH '06.

[11]  Greg Welch,et al.  Ensuring color consistency across multiple cameras , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[12]  Shigeyuki Sakazawa,et al.  I-077 Color Correction of Multiview Camera System Using Matched Feature Points , 2007 .

[13]  Toshiaki Fujii,et al.  Colour Correction for Multiple-camera System by Using Correspondences , 2007 .

[14]  Marc Pollefeys,et al.  Radiometric alignment of image sequences , 2004, CVPR 2004.

[15]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[16]  Toshiaki Fujii,et al.  Realtime System of Free Viewpoint Television , 2005 .

[17]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[18]  Toshiaki Fujii,et al.  Multiview Video Coding Using View Interpolation and Color Correction , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Shigeyuki Sakazawa,et al.  Free viewpoint video generation for walk-through experience using image-based rendering , 2008, ACM Multimedia.