Efficient highlight removal of metal surfaces

This paper proposes a novel, simple but fairly effective algorithm based on polynomial calibration function and inpainting method to address the problem of removing large-scale highlights from metal surfaces in an image. Our algorithm works upon an underlying premise that neighboring pixels in space-time with similar intensities should have similar colors. The entire system mainly consists of four components. First, the candidates of highlight areas are identified based on a modified specular free model, and then these candidates are represented in HSV color space. Next, the color channel V is re-calculated by using a luminance calibration formula. Afterwards, highlight areas in H and S color channels are recovered based on a novel inpainting method. Finally, the restored image is obtained by converting the integration results from HSV back to RGB color space. The experimental results on a number of images captured from rail transportation scenario and comparisons with other state-of-the-art approaches demonstrate the effectiveness of the proposed work. An efficient method for removing highlights from metal surfaces in an image.Subjective and objective evaluations on real video surveillance data.Comparisons with other state-of-the-art methods.

[1]  David J. Kriegman,et al.  Specularity Removal in Images and Videos: A PDE Approach , 2006, ECCV.

[2]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[3]  Katsushi Ikeuchi,et al.  Separating Reflection Components of Textured Surfaces Using a Single Image , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Narendra Ahuja,et al.  Real-Time Specular Highlight Removal Using Bilateral Filtering , 2010, ECCV.

[5]  L. Shao,et al.  From Heuristic Optimization to Dictionary Learning: A Review and Comprehensive Comparison of Image Denoising Algorithms , 2014, IEEE Transactions on Cybernetics.

[6]  Fernando Torres Medina,et al.  A New Inpainting Method for Highlights Elimination by Colour Morphology , 2005, ICAPR.

[7]  Shree K. Nayar,et al.  Separation of Reflection Components Using Color and Polarization , 1997, International Journal of Computer Vision.

[8]  Lizhuang Ma,et al.  Metal highlight spots removal based on multi-light-sources and total variation inpainting , 2006, VRCIA '06.

[9]  Gerard de Haan,et al.  An Overview and Performance Evaluation of Classification-Based Least Squares Trained Filters , 2008, IEEE Transactions on Image Processing.

[10]  Takeo Kanade,et al.  The measurement of highlights in color images , 1988, International Journal of Computer Vision.

[11]  Katsushi Ikeuchi,et al.  Reflection components decomposition of textured surfaces using linear basis functions , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[13]  Honggang Zhang,et al.  Chromaticity-based separation of reflection components in a single image , 2008, Pattern Recognit..

[14]  Ze-Nian Li,et al.  Review and Preview: Disocclusion by Inpainting for Image-Based Rendering , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[15]  Stefan Winkler,et al.  Digital Video Quality: Vision Models and Metrics , 2005 .

[16]  Tan Ping Illumination-Constrained Inpainting for Single Image Highlight Removal , 2004 .

[17]  Dani Lischinski,et al.  Colorization using optimization , 2004, SIGGRAPH 2004.

[18]  Alexandru Telea,et al.  An Image Inpainting Technique Based on the Fast Marching Method , 2004, J. Graphics, GPU, & Game Tools.

[19]  Hui-Liang Shen,et al.  Simple and efficient method for specularity removal in an image. , 2009, Applied optics.

[20]  B. S. Manjunath,et al.  Unsupervised Segmentation of Color-Texture Regions in Images and Video , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[22]  In-So Kweon,et al.  Fast Separation of Reflection Components using a Specularity-Invariant Image Representation , 2006, 2006 International Conference on Image Processing.

[23]  Hui-Liang Shen,et al.  Real-time highlight removal using intensity ratio. , 2013, Applied optics.

[24]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[25]  Ling Shao,et al.  Nonlocal Hierarchical Dictionary Learning Using Wavelets for Image Denoising , 2013, IEEE Transactions on Image Processing.

[26]  Guy Godin,et al.  Separation of diffuse and specular components of surface reflection by use of polarization and statistical analysis of images , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  David J. Kriegman,et al.  Dichromatic separation: specularity removal and editing , 2006, SIGGRAPH '06.

[28]  Pau-Choo Chung,et al.  A Fast Algorithm for Multilevel Thresholding , 2001, J. Inf. Sci. Eng..

[29]  Ying Zhang,et al.  Removing of Metal Highlight Spots Based on Total Variation Inpainting with Multi-sources-flashing , 2005, CIS.

[30]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .