3DNSITE: a networked interactive 3D visualization system to simplify location awareness in crisis management

We report on the 3DNSITE system, a web-based client-server 3D visualization tool for streaming and visualizing large tridimensional hybrid data (georeferenced point clouds and photographs with associated viewpoints and camera parameters). The system is motivated by the need to simplify data acquisition and location recognition for crisis managers and first responders during emergency operations or training sessions. In this peculiar context, it is very important to easily share 3D environment data among people in a distributed environment, accessing huge 3D models with embedded photographs on devices with heterogenous hardware capabilities and interconnected on different network types. Moreover, since the specific end-users are not necessary skilled with virtual reality and 3D objects interaction, the navigation interface must be simple and intuitive. Taking into account these constraints, we propose a mixel object-based/image-based system, which enhances the current state-of-the-art by exploiting a multi-resolution representation for the 3D model and a multi-level cache system for both the images and 3D models structure. A novel low-degree-of-freedom user interface is presented to navigate in the scenario with touchscreen devices. The proposed implementation, included in a more general training and decision framework for emergency operations, is evaluated on real-world datasets.

[1]  Julie Dugdale,et al.  Simulation and Emergency Management , 2010 .

[2]  Paolo Cignoni,et al.  Joint Interactive Visualization of 3D Models and Pictures in Walkable Scenes , 2012, Eurographics.

[3]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[4]  Ruggero Pintus,et al.  Fast and Robust Semi-Automatic Registration of Photographs to 3D Geometry , 2011, VAST.

[5]  Ruggero Pintus,et al.  Fast low-memory seamless photo blending on massive point clouds using a streaming framework , 2011, JOCCH.

[6]  A. Boin The New World of Crises and Crisis Management: Implications for Policymaking and Research , 2009 .

[7]  Enrico Gobbetti,et al.  Layered Point Clouds , 2004, PBG.

[8]  François Gérard,et al.  Streaming and synchronization of multi-user worlds through HTTP/1.1 , 2011, Web3D '11.

[9]  Neil Ireson,et al.  User requirements for a collective intelligence emergency response system , 2009 .

[10]  Luc Vincent,et al.  Taking Online Maps Down to Street Level , 2007, Computer.

[11]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[12]  Neil Ireson,et al.  User requirements for a collective intelligence emergency response system , 2009, BCS HCI.

[13]  Starr Roxanne Hiltz,et al.  Online forums supporting grassroots participation in emergency preparedness and response , 2007, Commun. ACM.

[14]  Richard Szeliski,et al.  Street slide: browsing street level imagery , 2010, ACM Trans. Graph..

[15]  Zoran Popovic,et al.  PhotoCity: training experts at large-scale image acquisition through a competitive game , 2011, CHI.

[16]  Murray Turoff,et al.  Human-computer interaction , 2007, Commun. ACM.

[17]  Andrew Lippman,et al.  Movie-maps: An application of the optical videodisc to computer graphics , 1980, SIGGRAPH '80.

[18]  Michael Cohen,et al.  Street slide: browsing street level imagery , 2010, SIGGRAPH 2010.

[19]  Jiri Matas,et al.  Locally Optimized RANSAC , 2003, DAGM-Symposium.

[20]  Ian J. Grimstead,et al.  Collaborative visualization: current systems and future trends , 2011, Web3D '11.

[21]  Dinesh Manocha,et al.  Massive model visualization techniques: course notes , 2008, SIGGRAPH '08.

[22]  Richard Szeliski,et al.  Finding paths through the world's photos , 2008, ACM Trans. Graph..

[23]  Paolo Cignoni,et al.  Batched multi triangulation , 2005, VIS 05. IEEE Visualization, 2005..

[24]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[25]  R. Szeliski,et al.  Ambient point clouds for view interpolation , 2010, ACM Trans. Graph..

[26]  Enrico Gobbetti,et al.  High-quality networked terrain rendering from compressed bitstreams , 2007, Web3D '07.

[27]  Simon Fuhrmann,et al.  Ambient point clouds for view interpolation , 2010, SIGGRAPH 2010.

[28]  David P. Capel An Effective Bail-out Test for RANSAC Consensus Scoring , 2005, BMVC.

[29]  Sikun Li,et al.  Sorting unorganized photo sets for urban reconstruction , 2012, Graph. Model..

[30]  Paolo Cignoni,et al.  Adaptive TetraPuzzles: Ecient Out-of-Core Construction and Visualization of Gigantic Multiresolution Polygonal Models , 2004, SIGGRAPH 2004.

[31]  Paolo Cignoni,et al.  Adaptive tetrapuzzles: efficient out-of-core construction and visualization of gigantic multiresolution polygonal models , 2004, ACM Trans. Graph..

[32]  Dinesh Manocha,et al.  Quick-VDR: interactive view-dependent rendering of massive models , 2004, IEEE Visualization 2004.