Sketch‐based shape‐constrained fireworks simulation in head‐mounted virtual reality

In this paper we present a novel shape‐constrained fireworks simulation method with rich textures in an HMD (Helmet Mounted Display) virtual environment using sketched feature lines as input. Our approach first retrieves an object from a three‐dimensional (3D) model database using a sketch‐based 3D shape retrieval algorithm. Then, in order to approximate models with complex structures, we introduce a novel point sampling algorithm based on Gaussian curvatures, which stores not only the positions of the selected vertices but also the texture (UV) coordinates information for texture display. In addition, we introduce a multilevel explosion process so that the fireworks can dynamically form specific, visually pleasing shapes. Through our experiments, we demonstrate that our approach can produce better results than state‐of‐the‐art approaches.

[1]  D. Levin,et al.  Optimizing 3D triangulations using discrete curvature analysis , 2001 .

[2]  Zhigang Deng,et al.  Flock morphing animation , 2014, Comput. Animat. Virtual Worlds.

[3]  Takeo Igarashi,et al.  Sketch2VF: Sketch‐based flow design with conditional generative adversarial network , 2019, Comput. Animat. Virtual Worlds.

[4]  Marc Alexa,et al.  Sketch-based shape retrieval , 2012, ACM Trans. Graph..

[5]  Mark Meyer,et al.  Discrete Differential-Geometry Operators for Triangulated 2-Manifolds , 2002, VisMath.

[6]  David Cohen-Steiner,et al.  Restricted delaunay triangulations and normal cycle , 2003, SCG '03.

[7]  Xiaogang Jin,et al.  Turbulence synthesis for shape‐controllable smoke animation , 2014, Comput. Animat. Virtual Worlds.

[8]  Zhigang Deng,et al.  Sketch‐based shape‐preserving tree animations , 2018, Comput. Animat. Virtual Worlds.

[9]  Arjan Kuijper,et al.  Sketch-based 3D model retrieval using diffusion tensor fields of suggestive contours , 2010, ACM Multimedia.

[10]  Guoliang Luo,et al.  Shape‐constrained flying insects animation , 2019, Comput. Animat. Virtual Worlds.

[11]  Karthik Ramani,et al.  A 3D Model Retrieval Method Using 2D Freehand Sketches , 2005, International Conference on Computational Science.

[12]  P MoretonHenry,et al.  Functional optimization for fair surface design , 1992 .

[13]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[14]  David Swapp,et al.  An ‘In the Wild’ Experiment on Presence and Embodiment using Consumer Virtual Reality Equipment , 2016, IEEE Transactions on Visualization and Computer Graphics.

[15]  Benjamin Bustos,et al.  An Improved Histogram of Edge Local Orientations for Sketch-Based Image Retrieval , 2010, DAGM-Symposium.

[16]  Hsuan-Ting Chang,et al.  CUDA-Accelerated Rendering of Fireworks in Nearly Ultra High Definition Videos , 2016, 2016 IEEE Second International Conference on Multimedia Big Data (BigMM).

[17]  Cem Yuksel,et al.  Sample Elimination for Generating Poisson Disk Sample Sets , 2015, Comput. Graph. Forum.

[18]  Ian H. Witten,et al.  Managing Gigabytes: Compressing and Indexing Documents and Images , 1999 .

[19]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[20]  Carlo H. Séquin,et al.  Functional optimization for fair surface design , 1992, SIGGRAPH.

[21]  L. Váša,et al.  Mesh Statistics for Robust Curvature Estimation , 2016, Comput. Graph. Forum.

[22]  Thierry Pun,et al.  Content-based query of image databases: inspirations from text retrieval , 2000, Pattern Recognit. Lett..

[23]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[24]  Chang-Hun Kim,et al.  Visual simulation of fire-flakes synchronized with flame , 2017, The Visual Computer.