Specularity removal: A global energy minimization approach based on polarization imaging

Spatial varying coefficient of diffuse and specular image.A global energy function is constructed based on the independent assumption.A specific constraint to ensure the effectiveness of the final solution.Quantitive result evaluation based on histogram. Concentration of light energy in images causes strong highlights (specular reflection), and challenges the robustness of a large variety of vision algorithms, such as feature extraction and object detection. Many algorithms indeed assume perfect diffuse surfaces and ignore the specular reflections; specularity removal may thus be a preprocessing step to improve the accuracy of such algorithms. Regarding specularity removal, traditional color-based methods generate severe color distortions and local patch-based algorithms do not integrate long range information, which may result in artifacts. In this paper, we present a new image specularity removal method which is based on polarization imaging through global energy minimization. Polarization images provide complementary information and reduce color distortions. By minimizing a global energy function, our algorithm properly takes into account the long range cue and produces accurate and stable results. Compared to other polarization-based methods of the literature, our method obtains encouraging results, both in terms of accuracy and robustness.

[1]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[2]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[3]  Fabrice Meriaudeau,et al.  Polarization imaging applied to 3D reconstruction of specular metallic surfaces , 2005, IS&T/SPIE Electronic Imaging.

[4]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Abhijeet Ghosh,et al.  Single-shot Layered Reflectance Separation Using a Polarized Light Field Camera , 2016, EGSR.

[6]  Guodong Guo,et al.  A New Projection Space for Separation of Specular-Diffuse Reflection Components in Color Images , 2012, ACCV.

[7]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[8]  Dmitry Chetverikov,et al.  A Survey of Specularity Removal Methods , 2011, Comput. Graph. Forum.

[9]  HosniAsmaa,et al.  Secrets of adaptive support weight techniques for local stereo matching , 2013 .

[10]  Ramesh Raskar,et al.  Resolving Multipath Interference in Kinect: An Inverse Problem Approach , 2014, IEEE Sensors Journal.

[11]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  Ramesh Raskar,et al.  Fast separation of direct and global components of a scene using high frequency illumination , 2006, SIGGRAPH 2006.

[13]  Matthew O'Toole,et al.  3D Shape and Indirect Appearance by Structured Light Transport , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Margrit Gelautz,et al.  Secrets of adaptive support weight techniques for local stereo matching , 2013, Comput. Vis. Image Underst..

[15]  Katsushi Ikeuchi,et al.  Separating reflection components of textured surfaces using a single image , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Katsushi Ikeuchi,et al.  Separating reflection components based on chromaticity and noise analysis , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Shree K. Nayar,et al.  Separation of Reflection Components Using Color and Polarization , 1997, International Journal of Computer Vision.

[18]  VekslerOlga,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001 .

[19]  Stan Z. Li,et al.  Separating Specular and Diffuse Reflection Components in the HSI Color Space , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[20]  P. Peebles Probability, Random Variables and Random Signal Principles , 1993 .

[21]  Michael J. Cree,et al.  Understanding and Ameliorating Non-Linear Phase and Amplitude Responses in AMCW Lidar , 2011, Remote. Sens..

[22]  David Tschumperlé,et al.  A fast spatial patch blending algorithm for artefact reduction in pattern-based image inpainting , 2013, SA '13.

[23]  In-So Kweon,et al.  Specular Reflection Separation Using Dark Channel Prior , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Terrance E. Boult,et al.  Constraining Object Features Using a Polarization Reflectance Model , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Horst Bischof,et al.  Hough-based tracking of non-rigid objects , 2011, 2011 International Conference on Computer Vision.

[26]  Matthias Born,et al.  Principles of Optics: Electromagnetic Theory of Propa-gation, Interference and Di raction of Light , 1999 .

[27]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  David Fofi,et al.  Adaptive processing of catadioptric images using polarization imaging: towards a pola-catadioptric model , 2013 .

[29]  Guy Godin,et al.  Separation of diffuse and specular components of surface reflection by use of polarization and statistical analysis of images , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  R. Raskar,et al.  Resolving Multipath Interference in Kinect: An Inverse Problem Approach , 2014, IEEE Sensors Journal.

[31]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  M. Born Principles of Optics : Electromagnetic theory of propagation , 1970 .

[33]  Katsushi Ikeuchi,et al.  Measurement of surface orientations of transparent objects using polarization in highlight , 2001, Systems and Computers in Japan.

[34]  Ramin Zabih,et al.  Non-parametric Local Transforms for Computing Visual Correspondence , 1994, ECCV.

[35]  Fan Wang,et al.  Polarization-based specularity removal method with global energy minimization , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[36]  Aarnout Brombacher,et al.  Probability... , 2009, Qual. Reliab. Eng. Int..

[37]  Takeo Kanade,et al.  The measurement of highlights in color images , 1988, International Journal of Computer Vision.

[38]  Max Born,et al.  Principles of optics - electromagnetic theory of propagation, interference and diffraction of light (7. ed.) , 1999 .

[39]  Mirko Schmidt,et al.  SRA: Fast Removal of General Multipath for ToF Sensors , 2014, ECCV.

[40]  Alexandrina Rogozan,et al.  A robust cost function for stereo matching of road scenes , 2014, Pattern Recognit. Lett..