Automatic illumination and color compensation using mean shift and sigma filter

We present a novel framework for automatic illumination and color compensation algorithm using mean shift and the sigma filter (ICCMS) to restore distorted images taken under the arbitrary lighting conditions. The proposed method is effective for appropriate illumination compensation, vivid color restoration, artifacts suppression, automatic parameter estimation, and low computational cost for HW implementation. We show the efficiency of the mean shift filter and sigma filter for illumination compensation with small sized kernel while considering the processing time and removing the artifacts such as HALO and noise amplification. The proposed color restoration function can restore the natural color and correct color noise artifact more perceptually compared with conventional methods. For the automatic processing, the image statistics analysis estimates suitable parameter and all constants are pre-defined. We also introduce the ROI-based parameter estimation dealing with small shadow area against spacious well-exposed background in an image for the touch-screen camera. The object evaluation is performed by CMC, CIEde2000, PSNR, SSIM, and 3D CIELAB gamut with state-of-the-art research and existing commercial solutions.

[1]  Jong-Sen Lee,et al.  Digital image smoothing and the sigma filter , 1983, Comput. Vis. Graph. Image Process..

[2]  E H Land,et al.  An alternative technique for the computation of the designator in the retinex theory of color vision. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Yiu-Fai Wong.  Image enhancement by edge-preserving filtering , 1994, Proceedings of 1st International Conference on Image Processing.

[4]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[5]  Rahman Zia-ur,et al.  A Comparison of the Multiscale Retinex With Other Image Enhancement Techniques , 1997 .

[6]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[7]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  Dorin Comaniciu,et al.  Mean shift analysis and applications , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  M. Luo,et al.  The development of the CIE 2000 Colour Difference Formula , 2001 .

[10]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[11]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Carlo Gatta,et al.  From Retinex to Automatic Color Equalization: issues in developing a new algorithm for unsupervised color equalization , 2004, J. Electronic Imaging.

[13]  Laurence Meylan,et al.  Bio-inspired color image enhancement , 2004, IS&T/SPIE Electronic Imaging.

[14]  Laurence Meylan,et al.  Color Image Enhancement Using A Retinex-Based Adaptive Filter , 2004, CGIV.

[15]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[16]  Frédo Durand,et al.  Flash photography enhancement via intrinsic relighting , 2004, SIGGRAPH 2004.

[17]  Jong-Myon Kim,et al.  Effective detection and elimination of impulse noise for reliable 4:2:0 YCbCr signals prior to compression encoding , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[18]  Michael Elad,et al.  Retinex by Two Bilateral Filters , 2005, Scale-Space.

[19]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, ACM Trans. Graph..

[20]  Whoi-Yul Kim,et al.  Color Image Enhancement Using the Laplacian Pyramid , 2006, PCM.

[21]  I. Safonov.  Automatic correction of amateur photos damaged by backlighting , 2006 .

[22]  Alessandro Rizzi,et al.  Random Spray Retinex: A New Retinex Implementation to Investigate the Local Properties of the Model , 2007, IEEE Transactions on Image Processing.

[23]  Carlo Gatta,et al.  Perceptually inspired HDR images tone mapping with color correction , 2007, Int. J. Imaging Syst. Technol..

[24]  Jan P. Allebach,et al.  Adaptive Bilateral Filter for Sharpness Enhancement and Noise Removal , 2007, 2007 IEEE International Conference on Image Processing.

[25]  Wolfgang Heidrich,et al.  Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs , 2007, SIGGRAPH 2007.

[26]  Wen Gao,et al.  Region-based visual attention analysis with its application in image browsing on small displays , 2007, ACM Multimedia.

[27]  Maneesh Agrawala,et al.  Multiscale shape and detail enhancement from multi-light image collections , 2007, SIGGRAPH 2007.

[28]  Antonios Gasteratos,et al.  Fast centre- surround contrast modification , 2008 .

[29]  Bo Li,et al.  A fast Multi-Scale Retinex algorithm for color image enhancement , 2008, 2008 International Conference on Wavelet Analysis and Pattern Recognition.

[30]  Carlo Gatta,et al.  A Spatially Variant White-Patch and Gray-World Method for Color Image Enhancement Driven by Local Contrast , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[32]  Sylvain Paris,et al.  Edge-Preserving Smoothing and Mean-Shift Segmentation of Video Streams , 2008, ECCV.

[33]  Nam Chul Kim,et al.  Color image enhancement using single-scale retinex based on an improved image formation model , 2008, 2008 16th European Signal Processing Conference.

[34]  Wei Guo,et al.  Luminance Based MSR for Color Image Enhancement , 2008, 2008 Congress on Image and Signal Processing.

[35]  Kwanghoon Sohn,et al.  Face relighting based on virtual irradiance sphere and reflection coefficient , 2008 .

[36]  Carlo S. Regazzoni,et al.  Multiple cue adaptive tracking of deformable objects with Particle Filter , 2008, 2008 15th IEEE International Conference on Image Processing.

[37]  Ruth Bergman,et al.  Perceptual Segmentation: Combining Image Segmentation With Object Tagging , 2011, IEEE Transactions on Image Processing.