Real-time feature-based image morphing for memory-efficient impostor rendering and animation on GPU

Real-time rendering of large animated crowds consisting of thousands of virtual humans is important for several applications including simulations, games, and interactive walkthroughs but cannot be performed using complex polygonal models at interactive frame rates. For that reason, methods using large numbers of precomputed image-based representations, called impostors, have been proposed. These methods take advantage of existing programmable graphics hardware to compensate for computational expense while maintaining visual fidelity. Thanks to these methods, the number of different virtual humans rendered in real time is no longer restricted by computational power but by texture memory consumed for the variety and discretization of their animations. This work proposes a resource-efficient impostor rendering methodology that employs image morphing techniques to reduce memory consumption while preserving perceptual quality, thus allowing higher diversity or resolution of the rendered crowds. Results of the experiments indicated that the proposed method, in comparison with conventional impostor rendering techniques, can obtain 38 % smoother animations or 87 % better appearance quality by reducing the number of key-frames required for preserving the animation quality via resynthesizing them with up to 92 % similarity on real time.

[1]  Craig W. Reynolds Big fast crowds on PS3 , 2006, Sandbox '06.

[2]  Wolfgang Stuerzlinger,et al.  A Three Dimensional Image Cache for Virtual Reality , 1996, Comput. Graph. Forum.

[3]  Carol O'Sullivan,et al.  Geopostors: a real-time geometry/impostor crowd rendering system , 2005, SIGGRAPH '05.

[4]  Andrew M. Day,et al.  A Key‐Pose Caching System for Rendering an Animated Crowd in Real‐Time , 2010, Comput. Graph. Forum.

[5]  Amitava Datta,et al.  Towards Quantitative Measures of Image Morphing Quality , 2005, Digital Image Computing: Techniques and Applications (DICTA'05).

[6]  Julie Dorsey,et al.  ACM SIGGRAPH 2006 Papers , 2006, SIGGRAPH 2006.

[7]  Daniel Thalmann,et al.  Challenges in Crowd Simulation , 2009, 2009 International Conference on CyberWorlds.

[8]  Rachel McDonnell,et al.  Perceptual Evaluation of Impostor Representations for Virtual Humans and Buildings , 2005, Comput. Graph. Forum.

[9]  Yiorgos Chrysanthou,et al.  Real-Time Rendering of Densely Populated Urban Environments , 2000, Rendering Techniques.

[10]  Erik Millán,et al.  Impostors and pseudo-instancing for GPU crowd rendering , 2006, GRAPHITE '06.

[11]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  David Salesin,et al.  Hierarchical image caching for accelerated walkthroughs of complex environments , 1996, SIGGRAPH.

[13]  Thomas W. Sederberg,et al.  A work minimization approach to image morphing , 1998, The Visual Computer.

[14]  Aura Conci,et al.  Real Time Feature-Based Parallel Morphing in GPU Applied to Texture-Based Animation , 2009, 2009 16th International Conference on Systems, Signals and Image Processing.

[15]  Aytül Erçil,et al.  Using Image Morphing for Memory-Efficient Impostor Rendering on GPU , 2011, 2011 International Conference on Cyberworlds.

[16]  Minoru Fukumi,et al.  Automatic human faces morphing using genetic algorithms based control points selection , 2007 .

[17]  Marcus A. Magnor,et al.  Perception-motivated interpolation of image sequences , 2008, APGV.

[18]  Thaddeus Beier,et al.  Feature-based image metamorphosis , 1998 .

[19]  Alan Heirich,et al.  Proceedings of the 2006 ACM SIGGRAPH symposium on Videogames, Sandbox '06, Boston, Massachusetts, USA, July 30-31, 2006 , 2006, Sandbox@SIGGRAPH.

[20]  Adrien Treuille,et al.  Continuum crowds , 2006, ACM Trans. Graph..

[21]  Jirí Zára,et al.  Polypostors: 2D polygonal impostors for 3D crowds , 2008, I3D '08.

[22]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[23]  Daniel Thalmann,et al.  Real-time display of virtual humans: levels of details and impostors , 2000, IEEE Trans. Circuits Syst. Video Technol..

[24]  Céline Loscos,et al.  Visualizing Crowds in Real‐Time , 2002, Comput. Graph. Forum.