3D graphics on the web: A survey

Abstract In recent years, 3D graphics has become an increasingly important part of the multimedia web experience. Following on from the advent of the X3D standard and the definition of a declarative approach to presenting 3D graphics on the web, the rise of WebGL has allowed lower level access to graphics hardware of ever increasing power. In parallel, remote rendering techniques permit streaming of high-quality 3D graphics onto a wide range of devices, and recent years have also seen much research on methods of content delivery for web-based 3D applications. All this development is reflected in the increasing number of application fields for the 3D web. In this paper, we reflect this activity by presenting the first survey of the state of the art in the field. We review every major approach to produce real-time 3D graphics rendering in the browser, briefly summarise the approaches for remote rendering of 3D graphics, before surveying complementary research on data compression methods, and notable application fields. We conclude by assessing the impact and popularity of the 3D web, reviewing the past and looking to the future.

[1]  Amy Henderson Squilacote The Paraview Guide , 2008 .

[2]  T. H. Kolbe,et al.  CityGML: Interoperable Access to 3D City Models , 2005 .

[3]  Sébastien Jourdain,et al.  ShareX3D, a scientific collaborative 3D viewer over HTTP , 2008, Web3D '08.

[4]  Akira Wakita,et al.  Using lattice for web-based medical applications , 2001, Web3D '01.

[5]  Guillaume Lavoué,et al.  Streaming compressed 3D data on the web using JavaScript and WebGL , 2013, Web3D '13.

[6]  Andrew Smith,et al.  Canvas 3D JS library , 2008, Future Play.

[7]  Enrico Gobbetti,et al.  Adaptive quad patches: an adaptive regular structure for web distribution and adaptive rendering of 3D models , 2012, Web3D '12.

[8]  David W. Walker,et al.  RAVE: the resource-aware visualization environment , 2009 .

[9]  Luca Chittaro,et al.  Web3D technologies in learning, education and training: Motivations, issues, opportunities , 2007, Comput. Educ..

[10]  Dieter Schmalstieg,et al.  A network architecture for remote rendering , 1998, Proceedings. 2nd International Workshop on Distributed Interactive Simulation and Real-Time Applications (Cat. No.98EX191).

[11]  Nigel W. John,et al.  The impact of Web3D technologies on medical education and training , 2007, Comput. Educ..

[12]  Michel Desvignes,et al.  A web interface for 3D visualization and interactive segmentation of medical images , 2012, Web3D '12.

[13]  Jakob Nielsen,et al.  Designing web usability , 1999 .

[14]  Stefan Decker,et al.  A dual-mode user interface for accessing 3D content on the world wide web , 2012, WWW.

[15]  Christopher D. Wickens,et al.  Virtual reality and education , 1992, [Proceedings] 1992 IEEE International Conference on Systems, Man, and Cybernetics.

[16]  Juan José Jiménez-Delgado,et al.  Development and evaluation of a 3D mobile application for learning manual therapy in the physiotherapy laboratory , 2013, Comput. Educ..

[17]  Jarek Rossignac,et al.  Optimal bit allocation in compressed 3D models , 1999, Comput. Geom..

[18]  Jan Herrington,et al.  Critical characteristics of situated learning: Implications for the instructional design of multimedia , 1995 .

[19]  Elizabeth Boese An Introduction to Programming with Java Applets , 2009 .

[20]  Gerrit Voss,et al.  CommonSurfaceShader revisited: improvements and experiences , 2012, Web3D '12.

[21]  Anthony Steed,et al.  3D revision control framework , 2012, Web3D '12.

[22]  Gilles Gesquière,et al.  3D Visualization of Urban Data Based on CityGML with WebGL , 2012, Int. J. 3 D Inf. Model..

[23]  Francesco Di Cerbo,et al.  Integrating a Web3D interface into an e-learning platform , 2010, Web3D '10.

[24]  Marcus Götz,et al.  Towards Interactive 3D City Models on the Web , 2012, Int. J. 3 D Inf. Model..

[25]  Kouichi Matsuda,et al.  WebGL Programming Guide: Interactive 3D Graphics Programming with WebGL , 2013 .

[26]  Alun Evans,et al.  WebGLStudio: a pipeline for WebGL scene creation , 2013, Web3D '13.

[27]  Charles Marion,et al.  Real-time collaborative scientific WebGL visualization with WebSocket , 2012, Web3D '12.

[28]  Felix Klein,et al.  XML3D and Xflow: Combining Declarative 3D for the Web with Generic Data Flows , 2013, IEEE Computer Graphics and Applications.

[29]  Roni Zeiger,et al.  Google Body: 3D human anatomy in the browser , 2011, SIGGRAPH '11.

[30]  Bettina Kemme,et al.  Peer-to-peer architectures for massively multiplayer online games: A Survey , 2013, CSUR.

[31]  Martin Hachet,et al.  A Survey of Interaction Techniques for Interactive 3D Environments , 2013, Eurographics.

[32]  Enrico Gobbetti,et al.  3DNSITE: a networked interactive 3D visualization system to simplify location awareness in crisis management , 2012, Web3D '12.

[33]  Raphaëlle Chaine,et al.  Simplification and streaming of GIS terrain for web clients , 2012, Web3D '12.

[34]  Marc Alexa,et al.  The POP Buffer: Rapid Progressive Clustering by Geometry Quantization , 2013, Comput. Graph. Forum.

[35]  Alun Evans,et al.  Combining educational MMO games with real sporting events , 2011, 6th Iberian Conference on Information Systems and Technologies (CISTI 2011).

[36]  Claudio Zunino,et al.  An accelerated remote graphics architecture for PDAS , 2003, Web3D '03.

[37]  Roberto Scopigno,et al.  Artworks narrating a story: a modular framework for the integrated presentation of three-dimensional and textual contents , 2013, Web3D '13.

[38]  Ghassan Al-Regib,et al.  BaTex3: Bit Allocation for Progressive Transmission of Textured 3-D Models , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[39]  Qiping Zhang,et al.  A Case Study of Communication and Social Interactions in Learning in Second Life , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[40]  Hillman Curtis Flash Web Design: The Art of Motion Graphics , 2000 .

[41]  Alan Miller,et al.  Educationally enhanced virtual worlds , 2010, 2010 IEEE Frontiers in Education Conference (FIE).

[42]  Thomas Ertl,et al.  Remote line rendering for mobile devices , 2004, Proceedings Computer Graphics International, 2004..

[43]  Yvonne Jung,et al.  Virtual heritage to go , 2012, Web3D '12.

[44]  Yo-Sung Ho,et al.  Predictive compression of geometry, color and normal data of 3-D mesh models , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[45]  Stefan Wagner,et al.  Fast delivery of 3D web content: a case study , 2013, Web3D '13.

[46]  Ismo Rakkolainen,et al.  A 3D City Info for mobile users , 2001, Comput. Graph..

[47]  Remi Arnaud,et al.  COLLADA: Sailing the Gulf of 3D Digital Content Creation , 2006 .

[48]  William Schroeder,et al.  The Visualization Toolkit: An Object-Oriented Approach to 3-D Graphics , 1997 .

[49]  Krzysztof Walczak,et al.  Building Virtual and Augmented Reality museum exhibitions , 2004, Web3D '04.

[50]  Timm Drevensek,et al.  Dynamic and interactive aspects of X3DOM , 2011, Web3D '11.

[51]  Shibu Mobile Application Development , 2012 .

[52]  C.-C. Jay Kuo,et al.  Technologies for 3D mesh compression: A survey , 2005, J. Vis. Commun. Image Represent..

[53]  Ariel Shamir,et al.  A survey on Mesh Segmentation Techniques , 2008, Comput. Graph. Forum.

[54]  David Oyarzun,et al.  Study of 3D web technologies for industrial applications , 2012, Web3D '12.

[55]  Chun,et al.  WebGL Models: End-to-End , 2012 .

[56]  Marius Preda,et al.  MPEG-4-based adaptive remote rendering for video games , 2011, Web3D '11.

[57]  Mark Lentczner,et al.  Second Life , 2007, USENIX Annual Technical Conference.

[58]  Neil A. Dodgson,et al.  Advances in Multiresolution for Geometric Modelling , 2005 .

[59]  Luca Chittaro,et al.  Proceedings of the ninth international conference on 3D Web technology , 2004 .

[60]  Alessandro De Gloria,et al.  Platform for Distributed 3D Gaming , 2009, Int. J. Comput. Games Technol..

[61]  Thierry Duval,et al.  Scene graph adapter: an efficient architecture to improve interoperability between 3D formats and 3D applications engines , 2011, Web3D '11.

[62]  Roberto Scopigno,et al.  SpiderGL: a JavaScript 3D graphics library for next-generation WWW , 2010, Web3D '10.

[63]  Ian J. Grimstead,et al.  Collaborative visualization: current systems and future trends , 2011, Web3D '11.

[64]  Guillaume Lavoué,et al.  Rate-distortion optimization for progressive compression of 3D mesh with color attributes , 2011, The Visual Computer.

[65]  Pierre Alliez,et al.  Progressive compression of manifold polygon meshes , 2012, Comput. Graph..

[66]  Jens Keil,et al.  A scalable architecture for the HTML5/X3D integration model X3DOM , 2010, Web3D '10.

[67]  Andrea De Lucia,et al.  Development and evaluation of a system enhancing Second Life to support synchronous role-based collaborative learning , 2009 .

[68]  Krzysztof Walczak,et al.  Digitisation to Presentation - Building Virtual Museum Exhibitions , 2003, VVG.

[69]  Peter Eisert,et al.  Depth map enhanced macroblock partitioning for H.264 video coding of computer graphics content , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[70]  Stephan Nebiker,et al.  Web-Based Large-Scale 3D-Geovisualisation Using WebGL: The OpenWebGlobe Project , 2012, Int. J. 3 D Inf. Model..

[71]  Gabriel Cirio,et al.  A Framework for Data-driven Progressive Mesh Compression , 2010, GRAPP.

[72]  Sixto Ortiz,et al.  Is 3D Finally Ready for the Web? , 2010, Computer.

[73]  Wei Li,et al.  3D web based surgical training through comparative analysis , 2013, Web3D '13.

[74]  Xavier Granier,et al.  Using expressive rendering for remote visualization of large city models , 2006, Web3D '06.

[75]  Gordon Stoll,et al.  WireGL: a scalable graphics system for clusters , 2001, SIGGRAPH.

[76]  Dieter Schmalstieg,et al.  Demand‐Driven Geometry Transmission for Distributed Virtual Environments , 1996, Comput. Graph. Forum.

[77]  Sheila J. Backman,et al.  Experiencing student learning and tourism training in a 3D virtual world: an exploratory study. , 2013 .

[78]  Marc Levoy Polygon-assisted JPEG and MPEG compression of synthetic images , 1995, SIGGRAPH.

[79]  Pierre Alliez,et al.  Recent advances in compression of 3D meshes , 2005, 2005 13th European Signal Processing Conference.

[80]  Alexander Zipf,et al.  Generating web-based 3D City Models from OpenStreetMap: The current situation in Germany , 2010, Comput. Environ. Urban Syst..

[81]  Tobias Alexander Franke,et al.  Using images and explicit binary container for efficient and incremental delivery of declarative 3D scenes on the web , 2012, Web3D '12.

[82]  Rémy Prost,et al.  Progressive Lossless Mesh Compression Via Incremental Parametric Refinement , 2009, Comput. Graph. Forum.

[83]  Holger Graf,et al.  X3DOM AS CARRIER OF THE VIRTUAL HERITAGE , 2012 .

[84]  Philipp Slusallek,et al.  Declarative integration of interactive 3D graphics into the world-wide web: principles, current approaches, and research agenda , 2013, Web3D '13.

[85]  Yo-Sung Ho,et al.  Color Data Coding for Three-Dimensional Mesh Models Considering Connectivity and Geometry Information , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[86]  Krzysztof Walczak,et al.  Virtual museum exbibitions , 2006, Computer.

[87]  Thanassis Tiropanis,et al.  The Web in education , 2012, Comput. Networks.

[88]  Sebastien Jourdain,et al.  ParaViewWeb : A Web Framework for 3 D Visualization and Data Processing , 2011 .

[89]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[90]  Hugues Hoppe,et al.  Efficient implementation of progressive meshes , 1998, Comput. Graph..

[91]  Giti Javidi,et al.  Virtual Reality and Education , 1999 .

[92]  Andre Charland,et al.  Mobile application development , 2011, Commun. ACM.

[93]  Iñaki Prieto,et al.  Visualization of 3D city models on mobile devices , 2012, Web3D '12.

[94]  Marc Antonini,et al.  An efficient bit allocation for compressing normal meshes with an error-driven quantization , 2005, Comput. Aided Geom. Des..

[95]  Pierre Alliez,et al.  Progressive compression for lossless transmission of triangle meshes , 2001, SIGGRAPH.

[96]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[97]  Jürgen Döllner,et al.  Interactive software maps for web-based source code analysis , 2013, Web3D '13.

[98]  Antoine Quint,et al.  Scalable Vector Graphics , 2020, Definitions.

[99]  Chaomei Chen,et al.  Visualizing Information Using SVG and X3D , 2004 .

[100]  Michael Zöllner,et al.  X3DOM: a DOM-based HTML5/X3D integration model , 2009, Web3D '09.

[101]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[102]  Fabio Ganovelli,et al.  Features and Design Choices in SpiderGL , 2012 .

[103]  Jürgen Döllner,et al.  Annotating 3D content in interactive, virtual worlds , 2013, Web3D '13.

[104]  W. Robert J. Funnell,et al.  A VRML-based anatomical visualization tool for medical education , 1998, IEEE Transactions on Information Technology in Biomedicine.

[105]  R. de Tornyay Up and running. , 1983, The Journal of nursing education.

[106]  Dieter W. Fellner,et al.  A modern declarative surface shader for X3D , 2010, Web3D '10.

[107]  Christian Ulbrich,et al.  A DCC pipeline for native 3D graphics in browsers , 2012, Web3D '12.

[108]  B R Schatz,et al.  NCSA Mosaic and the World Wide Web: Global Hypermedia Protocols for the Internet , 1994, Science.

[109]  Brandon Jones,et al.  WebGL Beginner's Guide , 2012 .

[110]  Daniel Cohen-Or,et al.  Streaming Scenes to MPEG-4 Video-Enabled Devices , 2003, IEEE Computer Graphics and Applications.

[111]  Michael Thornton Wyman,et al.  2 – World of Warcraft , 2011 .

[112]  Andrea Sanna,et al.  Web-based 3D visualization for intelligent street lighting , 2011, Web3D '11.

[113]  Piero Cosi,et al.  A 3D Talking Head for mobile devices based on unofficial iOS WebGL support , 2012, Web3D '12.

[114]  Aitor Moreno,et al.  Interactive visualization of volumetric data with WebGL in real-time , 2011, Web3D '11.

[115]  Enrico Gobbetti,et al.  Compression-domain seamless multiresolution visualization of gigantic triangle meshes on mobile devices , 2013, Web3D '13.

[116]  Fabio Remondino,et al.  Reality-Based 3D Modeling, Segmentation and Web-Based Visualization , 2010, EuroMed.

[117]  Daniel Cohen-Or,et al.  Selective Pixel Transmission for Navigating in Remote Virtual Environments , 1997, Comput. Graph. Forum.

[118]  Alun Evans,et al.  Assisted animated production creation and programme generation , 2009, Advances in Computer Entertainment Technology.

[119]  Ulrich Neumann,et al.  Web‐Based Remote Renderingwith IBRAC (Image‐Based Rendering Acceleration and Compression) , 2000, Comput. Graph. Forum.

[120]  Andy Hopper,et al.  Virtual Network Computing , 1998, IEEE Internet Comput..

[121]  Charles Marion,et al.  A hybrid visualization system for molecular models , 2013, Web3D '13.

[122]  Daniel Weiskopf GPU-Based Interactive Visualization Techniques (Mathematics and Visualization) , 2006 .

[123]  Tony Parisi,et al.  WebGL: Up and Running , 2012 .

[124]  Roberto Scopigno,et al.  Visualization methods for molecular studies on the web platform , 2010, Web3D '10.