Red-eye detection and correction using inpainting in digital photographs

When we take pictures with flash, red-eye effect often appears in photographs. Flash light passing through pupil is reflected on the blood vessels, and arrives at a camera lens. This phenomenon makes red-eyes in photographs. Several algorithms have been proposed for removal of red-eyes in digital photographs. This paper proposes a red-eye removal algorithm using inpainting and eye-metric information, which is largely composed of two parts: red-eye detection and red-eye correction. For red-eye detection, face regions are detected first. Next, red-eye regions are segmented in the face regions using multi-cues such as redness, shape, and color information. By region growing, we select regions, which are to be completed with iris texture by an exemplar-based inpainting method. Then, for red-eye correction, pupils are painted with the appropriate radii calculated from the iris size and size ratio. Experimental results with a large number of test photographs with red-eye effect show that the proposed algorithm is effective and the corrected eyes look more natural than those processed by the conventional algorithms.

[1]  Patrick Vandewalle,et al.  Automatic Red-Eye Removal based on Sclera and Skin Tone Detection , 2006, CGIV.

[2]  Sergey Ioffe,et al.  Red eye detection with machine learning , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[3]  Narciso García,et al.  Fast face segmentation in component color space , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[4]  Raimondo Schettini,et al.  A modular procedure for automatic red eye correction in digital photos , 2003, IS&T/SPIE Electronic Imaging.

[5]  Robert Ulichney Perceptual-based correction of photo red-eye , 2005, SIP.

[6]  Daniel Tretter,et al.  An efficient automatic redeye detection and correction algorithm , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[7]  B. Holden,et al.  A new method for measuring the diameter of the in vivo human cornea. , 1982, American journal of optometry and physiological optics.

[8]  Yue Qi,et al.  An image inpainting method , 2005, Ninth International Conference on Computer Aided Design and Computer Graphics (CAD-CG'05).

[9]  Mingjing Li,et al.  Automated red-eye detection and correction in digital photographs , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[10]  Gabriela Csurka,et al.  Probabilistic Automatic Red Eye Detection and Correction , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[11]  Robert Ulichney,et al.  Automatic red-eye detection and correction , 2002, Proceedings. International Conference on Image Processing.

[12]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  Narciso García,et al.  Face detection based on a new color space YCgCr , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[14]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[15]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[16]  Donald Decker,et al.  An evaluation of pupil size standards used by police officers for detecting drug impairment. , 2004, Optometry.