YUV-based material modeling from a single image

Different from traditional algorithms, the material modeling method utilizing luma Y in YUV color space has been developed in this paper. Our method, which interactively acquires material appearance from a single image, includes four main steps: removing highlight, recovering normal based on luma Y, estimating diffuse coefficient, setting glossiness and specular coefficient interactively. The experiment results indicate that the proposed technique can effectively extract the material appearance from a single image within several seconds.

[1]  Baining Guo,et al.  AppGen: interactive material modeling from a single image , 2011, ACM Trans. Graph..

[2]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Christopher Schwartz,et al.  Design and Implementation of Practical Bidirectional Texture Function Measurement Devices Focusing on the Developments at the University of Bonn , 2014, Sensors.

[4]  Hui-Liang Shen,et al.  Real-time highlight removal using intensity ratio. , 2013, Applied optics.

[5]  Jirí Filip,et al.  Rapid Material Appearance Acquisition Using Consumer Hardware , 2014, Sensors.

[6]  Stephen Lin,et al.  Highlight removal by illumination-constrained inpainting , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[8]  Jirí Filip,et al.  Digital Material Appearance: The Curse of Tera-Bytes , 2012, ERCIM News.

[9]  Narendra Ahuja,et al.  Real-Time Specular Highlight Removal Using Bilateral Filtering , 2010, ECCV.

[10]  Tan Ping.  Illumination-Constrained Inpainting for Single Image Highlight Removal , 2004 .

[11]  Honggang Zhang,et al.  Chromaticity-based separation of reflection components in a single image , 2008, Pattern Recognit..

[12]  Jitendra Malik,et al.  Shape, Illumination, and Reflectance from Shading , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Tim Weyrich,et al.  Principles of appearance acquisition and representation , 2007, SIGGRAPH '08.

[14]  Jaakko Lehtinen,et al.  Practical SVBRDF capture in the frequency domain , 2013, ACM Trans. Graph..

[15]  James F. Blinn,et al.  Models of light reflection for computer synthesized pictures , 1977, SIGGRAPH.