Water Surface Modeling from a Single Viewpoint Video

We introduce a video-based approach for producing water surface models. Recent advances in this field output high-quality results but require dedicated capturing devices and only work in limited conditions. In contrast, our method achieves a good tradeoff between the visual quality and the production cost: It automatically produces a visually plausible animation using a single viewpoint video as the input. Our approach is based on two discoveries: first, shape from shading (SFS) is adequate to capture the appearance and dynamic behavior of the example water; second, shallow water model can be used to estimate a velocity field that produces complex surface dynamics. We will provide qualitative evaluation of our method and demonstrate its good performance across a wide range of scenes.

[1]  Markus H. Gross,et al.  Real-time Breaking Waves for Shallow Water Simulations , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[2]  Marcus A. Magnor,et al.  Reconstructing the geometry of flowing water , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[3]  Volker Hilsenstein Surface Reconstruction of Water Waves using Thermographic Stereo Imaging , 2005 .

[4]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[5]  Kiriakos N. Kutulakos,et al.  Dynamic Refraction Stereo , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Dimitris N. Metaxas,et al.  Realistic Animation of Liquids , 1996, Graphics Interface.

[7]  Hans-Peter Seidel,et al.  Performance capture from sparse multi-view video , 2008, ACM Trans. Graph..

[8]  Erik Reinhard,et al.  Depicting procedural caustics in single images , 2008, SIGGRAPH Asia '08.

[9]  Adrian G. Bors,et al.  Navier-Stokes Formulation for Modelling Turbulent Optical Flow , 2007, BMVC.

[10]  Hyeong-Seok Ko,et al.  Detail-preserving fully-Eulerian interface tracking framework , 2010, ACM Trans. Graph..

[11]  Long Quan,et al.  Image-based tree modeling , 2007, ACM Trans. Graph..

[12]  Huamin Wang,et al.  Physically guided liquid surface modeling from videos , 2009, ACM Trans. Graph..

[13]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[14]  Pieter Peers,et al.  Practical modeling and acquisition of layered facial reflectance , 2008, SIGGRAPH Asia '08.

[15]  Robert Bridson,et al.  Guide shapes for high resolution naturalistic liquid simulation , 2011, ACM Trans. Graph..

[16]  Bernd Jähne,et al.  Multichannel Shape from Shading Techniques for Moving Specular Surfaces , 1998, ECCV.

[17]  Yoshikazu Nakajima,et al.  Physics-based flow estimation of fluids , 2003, Pattern Recognit..

[18]  Hyeongseok Ko,et al.  Detail-preserving fully-Eulerian interface tracking framework , 2010, SIGGRAPH 2010.

[19]  Hyeong-Seok Ko,et al.  Stable but nondissipative water , 2005, TOGS.

[20]  R. Fedkiw,et al.  A novel algorithm for incompressible flow using only a coarse grid projection , 2010, ACM Trans. Graph..

[21]  Philip J. Willis,et al.  Reconstructing Mass-Conserved Water Surfaces Using Shape from Shading and Optical Flow , 2010, ACCV.

[22]  Christof Rezk Salama,et al.  GPU-Based Monte-Carlo Volume Raycasting , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[23]  Ming C. Lin,et al.  Fast animation of turbulence using energy transport and procedural synthesis , 2008, SIGGRAPH Asia '08.

[24]  Markus Gross,et al.  Real-time Breaking Waves for Shallow Water Simulations , 2007 .

[25]  Mark J. Huiskes,et al.  DynTex: A comprehensive database of dynamic textures , 2010, Pattern Recognit. Lett..

[26]  Frédo Durand,et al.  Hair photobooth: geometric and photometric acquisition of real hairstyles , 2008, ACM Trans. Graph..

[27]  D. House,et al.  Wave particles , 2007, SIGGRAPH 2007.

[28]  Erik Reinhard,et al.  Image-based material editing , 2005, SIGGRAPH '05.

[29]  Hidetomo Sakaino Fluid motion estimation method based on physical properties of waves , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Robert Bridson,et al.  Fluid Simulation for Computer Graphics , 2008 .

[31]  Markus Gross,et al.  Two-scale particle simulation , 2011, SIGGRAPH 2011.

[32]  Markus H. Gross,et al.  Two-scale particle simulation , 2011, ACM Trans. Graph..

[33]  William L. Briggs,et al.  A multigrid tutorial, Second Edition , 2000 .

[34]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[35]  Mubarak Shah,et al.  Shape from shading using linear approximation , 1994, Image Vis. Comput..

[36]  Hiroshi Murase,et al.  Surface Shape Reconstruction of a Nonrigid Transport Object Using Refraction and Motion , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Jos Stam,et al.  Stable fluids , 1999, SIGGRAPH.