Specular highlight enhancement from video sequences

We propose a novel method for detecting and enhancing specular highlights from a video sequence, thereby obtaining a better visual perception of the specularity. To this end, we first generate a specularity map, defined over the space-time domain, by leveraging information provided by the temporal acquisition. We then amplify the highlights in each video frame to create the visual sensation of high dynamic range data. Results are illustrated on several videos taken under different acquisition scenarios.

[1]  Joost van de Weijer,et al.  Computational Color Constancy: Survey and Experiments , 2011, IEEE Transactions on Image Processing.

[2]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[3]  Laurence Meylan,et al.  Tone mapping for high dynamic range displays , 2007, Electronic Imaging.

[4]  Stephen Lin,et al.  Diffuse-Specular Separation and Depth Recovery from Image Sequences , 2002, ECCV.

[5]  Sang Wook Lee,et al.  Detection of specularity using colour and multiple views , 1992, Image Vis. Comput..

[6]  Katsushi Ikeuchi,et al.  Separating Reflection Components of Textured Surfaces Using a Single Image , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[8]  Wolfgang Heidrich,et al.  Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs , 2007, SIGGRAPH 2007.

[9]  Ramesh Raskar,et al.  Fast separation of direct and global components of a scene using high frequency illumination , 2006, ACM Trans. Graph..

[10]  Edward H. Adelson,et al.  Human-assisted motion annotation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Dmitry Chetverikov,et al.  A Survey of Specularity Removal Methods , 2011, Comput. Graph. Forum.

[12]  Ramesh Raskar,et al.  Specular reflection reduction with multi-flash imaging , 2004, Proceedings. 17th Brazilian Symposium on Computer Graphics and Image Processing.

[13]  Hans-Peter Seidel,et al.  Enhancement of Bright Video Features for HDR Displays , 2008 .

[14]  Hans-Peter Seidel,et al.  Analysis of Reproducing Real‐World Appearance on Displays of Varying Dynamic Range , 2006, Comput. Graph. Forum.

[15]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[16]  Kun Zhou,et al.  High dynamic range image hallucination , 2007, SIGGRAPH '07.

[17]  Dani Lischinski,et al.  Content‐Aware Automatic Photo Enhancement , 2012, Comput. Graph. Forum.

[18]  Shree K. Nayar,et al.  Separation of Reflection Components Using Color and Polarization , 1997, International Journal of Computer Vision.