Illumination Recovery for Realistic Fluid Re-simulation

Previous studies in fluid re-simulation have devoted to reducing computational complexity, and little attention has been paid to realistic aspects. This paper presents a linear approach to estimate illumination from video examples for coherent photorealistic re-simulation. Compared with the previous study of light detection, it couples the reconstructed fluid geometry with surface appearance and linearly estimates illumination parameters, which avoids much higher computational cost from tedious optimization. The parameters in Blinn-Phong shading model (BSM) are recovered hierarchically. Based on fitting the ambient and diffuse components through the particles with lower intensities, reflectance can be clustered from the observations of high-intensity particles surface. We demonstrate its effectiveness for both steps by extensive quantitative and qualitative evaluation through relighting on the fluid surface from ground truth fluid video, as well as from re-simulation. Photorealistic coherently illuminated visual effects consistent with fluid surface geometry are obtained.

[1]  Jannik Boll Nielsen,et al.  Addressing grazing angle reflections in Phong models , 2014, SIGGRAPH ASIA Posters.

[2]  Ko Nishino,et al.  Reflectance and Illumination Recovery in the Wild , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Mark J. Huiskes,et al.  DynTex: A comprehensive database of dynamic textures , 2010, Pattern Recognit. Lett..

[4]  Luiz Velho,et al.  Sketch-based warping of RGBN images , 2011, Graph. Model..

[5]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[6]  Takeshi Shakunaga,et al.  Direct Bundle Estimation for Recovery of Shape, Reflectance Property and Light Position , 2008, ECCV.

[7]  Mingqi Yu,et al.  Fluid surface reconstruction based on specular reflection model , 2013, Comput. Animat. Virtual Worlds.

[8]  Chuohao Yeo,et al.  Intrinsic images decomposition using a local and global sparse representation of reflectance , 2011, CVPR 2011.

[9]  Ramesh Raskar,et al.  Fast separation of direct and global components of a scene using high frequency illumination , 2006, SIGGRAPH 2006.

[10]  Edward H. Adelson,et al.  Ground truth dataset and baseline evaluations for intrinsic image algorithms , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[11]  Jian Sun,et al.  Interactive normal reconstruction from a single image , 2008, SIGGRAPH 2008.

[12]  Stephen Lin,et al.  Intrinsic image decomposition with non-local texture cues , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[14]  A. Witkin,et al.  Recovering intrinsic scene characteristics from images , 1981 .

[15]  Berthold K. P. Horn,et al.  Determining lightness from an image , 1974, Comput. Graph. Image Process..

[16]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[17]  James Arvo,et al.  Painting with light , 1993, SIGGRAPH.