Local color correction of stereo pairs

The interest in the production of stereoscopic contents is growing rapidly. Stereo material can be produced using different solutions, from high level devices to standard digital cameras suitably coupled. In the latter case, color correction in stereoscopic images is complex, due to possible different Color Filter Arrays or settings in the two acquisition devices: users must often tune each camera separately, and this can lead to visible color inter-differences in the stereo pair. The color correction methods often considered in the post-processing stage of stereoscopic production are mainly based on global transformations between the two views, but this approach can not completely recover relevant limits in the gamuts of each image due to color distortions. In this paper we evaluate the application of perceptually-based spatial color computational models, based or inspired by Retinex theory, to pre-filter the stereo pairs. Spatial color algorithms apply an unsupervised local color correction to each pixel, based on a simulation of color perception mechanisms, and were proven to effectively reduce color dominants and adjust local contrasts in images. We filtered different stereoscopic streams with visible color differences between right and left frames, using a GPU version of the Random Spray Retinex (RSR) algorithm, that applies in few seconds an unsupervised color correction, and the Automatic Color Equalization (ACE) algorithm, that considers both White Patch and Gray World equalization mechanisms. We analyse the effect of the computational models both by visual assessment and by considering the changes in the image gamuts before and after the filtering.

[1]  Alessandro Rizzi,et al.  On the behavior of spatial models of color , 2007, Electronic Imaging.

[2]  Carlo Gatta,et al.  A new algorithm for unsupervised global and local color correction , 2003, Pattern Recognit. Lett..

[3]  Alessandro Rizzi,et al.  Mathematical definition and analysis of the retinex algorithm. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Jon Y. Hardeberg,et al.  Visualization and Interactive Manipulation of Color Gamuts , 2002, Color Imaging Conference.

[5]  J. Bercovitz Image-side perspective and stereoscopy , 1998, Electronic Imaging.

[6]  Sang Uk Lee,et al.  Illumination and camera invariant stereo matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  L. Lipton Foundations of the Stereoscopic Cinema , 1982 .

[8]  Janusz Konrad,et al.  Robust quadtree-based disparity estimation for the reconstruction of intermediate stereoscopic images , 1998, Electronic Imaging.

[9]  Stefano Soatto,et al.  A Variational Approach to Problems in Calibration of Multiple Cameras , 2007, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Andrew J. Woods,et al.  Image distortions in stereoscopic video systems , 1993, Electronic Imaging.

[11]  Raimondo Schettini,et al.  Unsupervised Color Film Restoration Using Adaptive Color Equalization , 2005, VISUAL.

[12]  C. Gatta,et al.  Local linear LUT method for spatial colour-correction algorithm speed-up , 2006 .

[13]  Derek H. Fender,et al.  Human Engineering in Stereoscopic Viewing Devices , 1993, Advances in Computer Vision and Machine Intelligence.

[14]  Alessandro Rizzi,et al.  Random Spray Retinex: A New Retinex Implementation to Investigate the Local Properties of the Model , 2007, IEEE Transactions on Image Processing.

[15]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[16]  H. Jorke,et al.  INFITEC-A NEW STEREOSCOPIC VISUALISATION TOOL BY WAVELENGTH MULTIPLEX IMAGING , 2003 .