Rendering of Bézier Surfaces on Handheld Devices

We present a method for the efficient rendering of large scale particle-based foam data in screen space using a GPU based rendering pipeline. Our approach employs a multi-pass rendering technique to imitate some of the effects that are commonly accomplished by using expensive ray-tracing based methods. We demonstrate through different scenarios that our pipeline is able to produce convincing foam renderings for large scale scenarios and it has a significant performance advantage compared to using ray-casting techniques for rendering such particle data.

[1]  C P Tsui,et al.  A 3D skeletal muscle model coupled with active contraction of muscle fibres and hyperelastic behaviour. , 2009, Journal of biomechanics.

[2]  Renato Pajarola,et al.  A unified particle model for fluid–solid interactions , 2007, Comput. Animat. Virtual Worlds.

[3]  Rüdiger Westermann,et al.  A real-time multigrid finite hexahedra method for elasticity simulation using CUDA , 2011, Simul. Model. Pract. Theory.

[4]  Ronald Fedkiw,et al.  So real it'll make you wet , 2006, SIGGRAPH '06.

[5]  Paolo Cignoni,et al.  Ambient Occlusion and Edge Cueing for Enhancing Real Time Molecular Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[6]  Yasushi Ito,et al.  Octree‐based reasonable‐quality hexahedral mesh generation using a new set of refinement templates , 2009 .

[7]  Marc Levoy,et al.  Texture synthesis over arbitrary manifold surfaces , 2001, SIGGRAPH.

[8]  Hans-Christian Hege,et al.  Computer Assisted Planning in Cranio-Maxillofacial Surgery , 2006, J. Comput. Inf. Technol..

[9]  Michael S. Floater,et al.  Mean value coordinates , 2003, Comput. Aided Geom. Des..

[10]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[11]  Steve Maddock,et al.  Physically‐based forehead animation including wrinkles , 2015, Comput. Animat. Virtual Worlds.

[12]  Matthias Teschner,et al.  Unified spray, foam and air bubbles for particle-based fluids , 2012, The Visual Computer.

[13]  D. F. Rogers,et al.  An Introduction to NURBS: With Historical Perspective , 2011 .

[14]  Eduard Gröller,et al.  Custom Interface Elements for Improved Parameter Control in Volume Rendering , 2010 .

[15]  Kwan-Liu Ma,et al.  An intelligent system approach to higher-dimensional classification of volume data , 2005, IEEE Transactions on Visualization and Computer Graphics.

[16]  Jihun Yu,et al.  Reconstructing surfaces of particle-based fluids using anisotropic kernels , 2010, SCA '10.

[17]  Hans-Peter Seidel,et al.  Approximating dynamic global illumination in image space , 2009, I3D '09.

[18]  James P. Ahrens,et al.  Scout: a hardware-accelerated system for quantitatively driven visualization and analysis , 2004, IEEE Visualization 2004.

[19]  Matthias Teschner,et al.  Parallel Surface Reconstruction for Particle‐Based Fluids , 2012, Comput. Graph. Forum.

[20]  B. Lamichhane.  Mortar Finite Elements for Coupling Compressible and Nearly Incompressible Materials in Elasticity , 2009 .

[21]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[22]  Günther Greiner,et al.  Simulation and Rendering of Liquid Foams , 2002, Graphics Interface.

[23]  Shenghui Liao,et al.  Facial hexahedral mesh transferring by volumetric mapping based on harmonic fields , 2011, Comput. Graph..

[24]  Cormac Flynn,et al.  Finite element modelling of forearm skin wrinkling , 2008, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[25]  Dimitris N. Metaxas,et al.  Simulation of two‐phase flow with sub‐scale droplet and bubble effects , 2009, Comput. Graph. Forum.

[26]  S. H. Martin Roth,et al.  A framework for facial surgery simulation , 2002, SCCG '02.

[27]  Louis Bavoil,et al.  Multi-layer dual-resolution screen-space ambient occlusion , 2009, SIGGRAPH '09.

[28]  Ronald Fedkiw,et al.  A Crystalline, Red Green Strategy for Meshing Highly Deformable Objects with Tetrahedra , 2003, IMR.

[29]  Patricia Crossno,et al.  Visual debugging of visualization software: a case study for particle systems , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[30]  Kun Zhou,et al.  Real-time soft shadows in dynamic scenes using spherical harmonic exponentiation , 2006, ACM Trans. Graph..

[31]  Takahiro Saito,et al.  Realistic Animation of Fluid with Splash and Foam , 2003, Comput. Graph. Forum.

[32]  A. Pullan,et al.  Three-dimensional finite element modelling of muscle forces during mastication. , 2007, Journal of biomechanics.

[33]  Tobias Isenberg,et al.  Semantics by analogy for illustrative volume visualization☆ , 2012, Comput. Graph..

[34]  Duc Quang Nguyen,et al.  Smoke simulation for large scale phenomena , 2003, ACM Trans. Graph..

[35]  Paul E. Debevec.  Image-Based Lighting , 2002, IEEE Computer Graphics and Applications.

[36]  Matthias Müller,et al.  Real-time simulation of large bodies of water with small scale details , 2010, SCA '10.

[37]  Karol Miller,et al.  Patient-specific non-linear finite element modelling for predicting soft organ deformation in real-time: application to non-rigid neuroimage registration. , 2010, Progress in biophysics and molecular biology.

[38]  Yongning Zhu,et al.  Animating sand as a fluid , 2005, SIGGRAPH 2005.

[39]  Edoardo Mazza,et al.  Physically Based Finite Element Model of the Face , 2008, ISBMS.

[40]  Michael Gertz,et al.  A model for the visualization exploration process , 2002, IEEE Visualization, 2002. VIS 2002..

[41]  Ronald Fedkiw,et al.  Automatic determination of facial muscle activations from sparse motion capture marker data , 2005, SIGGRAPH '05.

[42]  Marie-Paule Cani,et al.  Hierarchical pattern mapping , 2002, ACM Trans. Graph..

[43]  Konstantin Mischaikow,et al.  Feature-based surface parameterization and texture mapping , 2005, TOGS.

[44]  Pedro V. Sander,et al.  Texture mapping progressive meshes , 2001, SIGGRAPH.

[45]  Demetri Terzopoulos,et al.  Physically-based facial modelling, analysis, and animation , 1990, Comput. Animat. Virtual Worlds.

[46]  Sébastien Ourselin,et al.  High-Speed Nonlinear Finite Element Analysis for Surgical Simulation Using Graphics Processing Units , 2008, IEEE Transactions on Medical Imaging.

[47]  Konrad Polthier,et al.  CUBECOVER – Parameterization of 3D Volumes , 2011 .

[48]  Bruno Lévy,et al.  Constrained texture mapping for polygonal meshes , 2001, SIGGRAPH.

[49]  Ignacio Llamas,et al.  Simulation of bubbles in foam with the volume control method , 2007, SIGGRAPH 2007.

[50]  WestermannRudiger,et al.  Efficient High-Quality Volume Rendering of SPH Data , 2010 .

[51]  Niklas Elmqvist,et al.  Towards Utilizing GPUs in Information Visualization: A Model and Implementation of Image-Space Operations , 2009, IEEE Transactions on Visualization and Computer Graphics.

[52]  S. Padmanabhan,et al.  Implicit boundary method for finite element analysis using non‐conforming mesh or grid , 2008 .

[53]  Kenji Shimada,et al.  Hexahedral Mesh Matching: Converting non‐conforming hexahedral‐to‐hexahedral interfaces into conforming interfaces , 2010 .

[54]  Jeong-Mo Hong,et al.  Bubbles alive , 2008, SIGGRAPH 2008.

[55]  Kwan-Liu Ma,et al.  A cluster-space visual interface for arbitrary dimensional classification of volume data , 2004, VISSYM'04.

[56]  T. J. Jankun-Kelly,et al.  Visualization Exploration and Encapsulation via a Spreadsheet-Like Interface , 2001, IEEE Trans. Vis. Comput. Graph..

[57]  Mark Meyer,et al.  Generalized Barycentric Coordinates on Irregular Polygons , 2002, J. Graphics, GPU, & Game Tools.

[58]  Y Payan,et al.  The mesh-matching algorithm: an automatic 3D mesh generator for finite element structures. , 2000, Journal of biomechanics.

[59]  Hyewon Seo,et al.  Constrained Texture Mapping using Image Warping , 2010, Comput. Graph. Forum.

[60]  Chandrajit L Bajaj,et al.  An Automatic 3D Mesh Generation Method for Domains with Multiple Materials. , 2010, Computer methods in applied mechanics and engineering.

[61]  Lee-Sup Kim,et al.  Shader-based tessellation to save memory bandwidth in a mobile multimedia processor , 2009, Comput. Graph..

[62]  Michael Wimmer,et al.  A Layered Particle‐Based Fluid Model for Real‐Time Rendering of Water , 2010, Comput. Graph. Forum.

[63]  Ronald Fedkiw,et al.  Creating and simulating skeletal muscle from the visible human data set , 2005, IEEE Transactions on Visualization and Computer Graphics.

[64]  Thomas Ertl,et al.  A hardware-aware debugger for the OpenGL shading language , 2007, GH '07.

[65]  Kwan-Liu Ma,et al.  Visibility Histograms and Visibility-Driven Transfer Functions , 2011, IEEE Transactions on Visualization and Computer Graphics.

[66]  Mark Meyer,et al.  Intrinsic Parameterizations of Surface Meshes , 2002, Comput. Graph. Forum.

[67]  Peter Shirley,et al.  Fundamentals of computer graphics , 2018 .

[68]  Miguel Sainz,et al.  Screen space fluid rendering with curvature flow , 2009, I3D '09.

[69]  Xiaoru Yuan,et al.  WYSIWYG (What You See is What You Get) Volume Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[70]  Stefan Bruckner,et al.  Semantic Layers for Illustrative Volume Rendering , 2007, IEEE Transactions on Visualization and Computer Graphics.

[71]  Stefan Bruckner,et al.  Eurographics/ Ieee-vgtc Symposium on Visualization 2008 Interaction-dependent Semantics for Illustrative Volume Rendering , 2022 .

[72]  Ronald Fedkiw,et al.  Two-Way Coupled SPH and Particle Level Set Fluid Simulation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[73]  Alla Sheffer,et al.  Matchmaker: constructing constrained texture maps , 2003, ACM Trans. Graph..

[74]  Tamy Boubekeur,et al.  Generic mesh refinement on GPU , 2005, HWWS '05.

[75]  S. H. Lo,et al.  Automatic merging of hexahedral meshes , 2012 .

[76]  Jeffrey E. Bischoff,et al.  Reduced Parameter Formulation for Incorporating Fiber Level Viscoelasticity into Tissue Level Biomechanical Models , 2006, Annals of Biomedical Engineering.

[77]  Les A. Piegl,et al.  The NURBS Book , 1995, Monographs in Visual Communication.

[78]  Sergey Zhukov,et al.  An Ambient Light Illumination Model , 1998, Rendering Techniques.

[79]  Sara McMains,et al.  ACM SIGGRAPH 2007 courses , 2007, SIGGRAPH 2007.

[80]  Kumar Mithraratne,et al.  An Efficient Heterogeneous Continuum Model to Simulate Active Contraction of Facial Soft Tissue Structures , 2010 .

[81]  Matthias Teschner,et al.  Animation of Air Bubbles with SPH , 2011, GRAPP.

[82]  Rüdiger Westermann,et al.  Efficient High-Quality Volume Rendering of SPH Data , 2010, IEEE Transactions on Visualization and Computer Graphics.

[83]  Guoqun Zhao,et al.  Quality improvement methods for hexahedral element meshes adaptively generated using grid‐based algorithm , 2012 .

[84]  Kun Zhou,et al.  Debugging GPU stream programs through automatic dataflow recording and visualization , 2009, SIGGRAPH 2009.

[85]  Hans-Peter Seidel,et al.  Vector field based shape deformations , 2006, ACM Trans. Graph..

[86]  Okan Arikan,et al.  Hardware accelerated ambient occlusion techniques on GPUs , 2007, SI3D.

[87]  Nobuhiro Yoshikawa,et al.  Mechanical approach to aging and wrinkling of human facial skin based on the multistage buckling theory. , 2008, Medical engineering & physics.

[88]  Carla Maria Dal Sasso Freitas,et al.  Design of Multi-dimensional Transfer Functions Using Dimensional Reduction , 2007, EuroVis.

[89]  Reinhard Klein,et al.  GPU-based trimming and tessellation of NURBS and T-Spline surfaces , 2005, SIGGRAPH '05.

[90]  Huamin Wang,et al.  Animating bubble interactions in a liquid foam , 2012, ACM Trans. Graph..

[91]  Marco Fratarcangeli,et al.  Position‐based facial animation synthesis , 2012, Comput. Animat. Virtual Worlds.

[92]  Chee Kai Chua,et al.  Rapid Prototyping Applications in Medicine. Part 1: NURBS-Based Volume Modelling , 2001 .

[93]  Greg Turk,et al.  Texture synthesis on surfaces , 2001, SIGGRAPH.

[94]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[95]  Peter Xiaoping Liu,et al.  A Nonlinear Viscoelastic Tensor-Mass Visual Model for Surgery Simulation , 2011, IEEE Transactions on Instrumentation and Measurement.

[96]  Hans-Peter Seidel,et al.  Head shop: generating animated head models with anatomical structure , 2002, SCA '02.

[97]  Yingcai Wu,et al.  Interactive Transfer Function Design Based on Editing Direct Volume Rendered Images , 2007, IEEE Transactions on Visualization and Computer Graphics.

[98]  Craig Gotsman,et al.  Texture Mapping with Hard Constraints , 2001, Comput. Graph. Forum.

[99]  Xiaoru Yuan,et al.  Volume cutout , 2005, The Visual Computer.

[100]  Klaus Gärtner,et al.  Meshing Piecewise Linear Complexes by Constrained Delaunay Tetrahedralizations , 2005, IMR.

[101]  Jian-Jun Zhang,et al.  Automatic muscle generation for physically-based facial animation , 2010, SIGGRAPH '10.

[102]  Michael Todd Bunnell,et al.  Dynamic Ambient Occlusion and Indirect Lighting , 2005 .

[103]  T. Blacker,et al.  Unconstrained plastering—Hexahedral mesh generation via advancing‐front geometry decomposition , 2010 .

[104]  H. Shum,et al.  TextureMontage: Seamless Texturing of Arbitrary Surfaces From Multiple Images , 2005, SIGGRAPH 2005.

[105]  Martin Reimers,et al.  Semi‐Uniform Adaptive Patch Tessellation , 2009, Comput. Graph. Forum.

[106]  Matthias Teschner,et al.  An Efficient Surface Reconstruction Pipeline for Particle-Based Fluids , 2012, VRIPHYS.

[107]  Kok-Lim Low,et al.  Multi-resolution screen-space ambient occlusion , 2010, VRST '10.

[108]  Young-Jun Kim,et al.  A Mobile 3-D Display Processor With A Bandwidth-Saving Subdivider , 2012, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[109]  Matthias Müller,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2007) Screen Space Meshes , 2022 .

[110]  Paul E. Debevec,et al.  Image-based lighting , 2002, IEEE Computer Graphics and Applications.

[111]  Sylvain Lefebvre,et al.  Texture sprites: texture elements splatted on surfaces , 2005, I3D '05.

[112]  Peter-Pike J. Sloan,et al.  Real-time soft shadows in dynamic scenes using spherical harmonic exponentiation , 2006, SIGGRAPH 2006.

[113]  Eftychios Sifakis,et al.  Comprehensive biomechanical modeling and simulation of the upper body , 2009, TOGS.

[114]  Bringing High-End Graphics to Handheld Devices , 2011 .

[115]  Bruno Lévy,et al.  Least squares conformal maps for automatic texture atlas generation , 2002, ACM Trans. Graph..

[116]  Timo Ropinski,et al.  Interactive Design and Debugging of GPU-based Volume Visualizations , 2010, GRAPP.

[117]  Lee-Sup Kim,et al.  Tessellation-enabled shader for a bandwidth-limited 3D graphics engine , 2008, 2008 IEEE Custom Integrated Circuits Conference.

[118]  Greg Turk,et al.  Reconstructing surfaces of particle-based fluids using anisotropic kernels , 2010, SCA 2010.

[119]  Rob Bredow,et al.  Surf's up: the making of an animated documentary , 2007, SIGGRAPH '07.

[120]  Steve C. Maddock,et al.  Creating Animatable Non-Conforming Hexahedral Finite Element Facial Soft-Tissue Models for GPU Simulation , 2012 .

[121]  Marc Noy,et al.  Flipping Edges in Triangulations , 1996, SCG '96.

[122]  Yuan Chen,et al.  A relational debugging engine for the graphics pipeline , 2005, SIGGRAPH 2005.

[123]  Kumar Mithraratne,et al.  Characterizing facial tissue sliding using ultrasonography , 2010 .

[124]  Martin Mittring,et al.  Finding next gen: CryEngine 2 , 2007, SIGGRAPH Courses.