Fast and High Quality Highlight Removal From a Single Image

Specular reflection exists widely in photography and causes the recorded color deviating from its true value, thus, fast and high quality highlight removal from a single nature image is of great importance. In spite of the progress in the past decades in highlight removal, achieving wide applicability to the large diversity of nature scenes is quite challenging. To handle this problem, we propose an analytic solution to highlight removal based on an L2 chromaticity definition and corresponding dichromatic model. Specifically, this paper derives a normalized dichromatic model for the pixels with identical diffuse color: a unit circle equation of projection coefficients in two subspaces that are orthogonal to and parallel with the illumination, respectively. In the former illumination orthogonal subspace, which is specular-free, we can conduct robust clustering with an explicit criterion to determine the cluster number adaptively. In the latter, illumination parallel subspace, a property called pure diffuse pixels distribution rule helps map each specular-influenced pixel to its diffuse component. In terms of efficiency, the proposed approach involves few complex calculation, and thus can remove highlight from high resolution images fast. Experiments show that this method is of superior performance in various challenging cases.

[1]  Stephen Lin,et al.  Diffuse-Specular Separation and Depth Recovery from Image Sequences , 2002, ECCV.

[2]  Shree K. Nayar,et al.  Separation of Reflection Components Using Color and Polarization , 1997, International Journal of Computer Vision.

[3]  Ruigang Yang,et al.  A Uniform Framework for Estimating Illumination Chromaticity, Correspondence, and Specular Reflection , 2011, IEEE Transactions on Image Processing.

[4]  Katsushi Ikeuchi,et al.  Separating reflection components of textured surfaces using a single image , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Katsushi Ikeuchi,et al.  Temporal-color space analysis of reflection , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  David J. Kriegman,et al.  Specularity Removal in Images and Videos: A PDE Approach , 2006, ECCV.

[7]  Narendra Ahuja,et al.  Real-Time Specular Highlight Removal Using Bilateral Filtering , 2010, ECCV.

[8]  Mark S. Drew,et al.  The Zeta-image, illuminant estimation, and specularity manipulation , 2014, Comput. Vis. Image Underst..

[9]  Takayuki Okatani,et al.  Separation of Reflection Components by Sparse Non-negative Matrix Factorization , 2014, ACCV.

[10]  Jürgen Beyerer,et al.  Shape from Specular Reflection and Optical Flow , 2008, International Journal of Computer Vision.

[11]  Hui-Liang Shen,et al.  Real-time highlight removal using intensity ratio. , 2013, Applied optics.

[12]  In-So Kweon,et al.  Fast Separation of Reflection Components using a Specularity-Invariant Image Representation , 2006, 2006 International Conference on Image Processing.

[13]  Katsushi Ikeuchi,et al.  Illumination chromaticity estimation using inverse-intensity chromaticity space , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[14]  Takeo Kanade,et al.  The measurement of highlights in color images , 1988, International Journal of Computer Vision.

[15]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[16]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[17]  Chein-I Chang,et al.  Orthogonal subspace projection (OSP) revisited: a comprehensive study and analysis , 2005, IEEE Trans. Geosci. Remote. Sens..

[18]  Lawrence B. Wolff,et al.  Polarization-Based Material Classification from Specular Reflection , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Mark S. Drew,et al.  4-sensor camera calibration for image representation invariant to shading, shadows, lighting, and specularities , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[20]  Hans-Peter Seidel,et al.  Mesostructure from Specularity , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[21]  Dmitry Chetverikov,et al.  A Survey of Specularity Removal Methods , 2011, Comput. Graph. Forum.

[22]  Ramesh Raskar,et al.  Specular reflection reduction with multi-flash imaging , 2004, Proceedings. 17th Brazilian Symposium on Computer Graphics and Image Processing.

[23]  Katsushi Ikeuchi,et al.  Reflection components decomposition of textured surfaces using linear basis functions , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  Stephen Lin,et al.  Variational Specular Separation Using Color and Polarization , 2002, MVA.

[25]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[26]  In-So Kweon,et al.  Specular Reflection Separation Using Dark Channel Prior , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  J. Parkkinen,et al.  Highlight detection and removal from spectral image. , 2011, Journal of the Optical Society of America. A, Optics, image science, and vision.

[28]  Cong Phuoc Huynh,et al.  A Solution of the Dichromatic Model for Multispectral Photometric Invariance , 2010, International Journal of Computer Vision.

[29]  Stephen Lin,et al.  Separation of diffuse and specular reflection in color images , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[30]  Sang Wook Lee,et al.  Detection of diffuse and specular interface reflections and inter-reflections by color image segmentation , 1996, International Journal of Computer Vision.

[31]  Guy Godin,et al.  Separation of diffuse and specular components of surface reflection by use of polarization and statistical analysis of images , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  David J. Kriegman,et al.  Beyond Lambert: reconstructing specular surfaces using color , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[33]  Lilong Shi,et al.  Dichromatic Illumination Estimation via Hough Transforms in 3D , 2008, CGIV/MCS.