IsoCam: Interactive Visual Exploration of Massive Cultural Heritage Models on Large Projection Setups

We introduce a novel user interface and system for exploring extremely detailed 3D models in a museum setting. Three-dimensional models and associated information are presented on a large projection surface controlled by a touch-enabled surface placed at a suitable distance in front of it. Our indirect user interface, dubbed IsoCam, combines an object-aware interactive camera controller with an interactive point-of-interest selector and is implemented within a scalable implementation based on multiresolution structures shared between the rendering and user interaction subsystems. The collision-free camera controller automatically supports the smooth transition from orbiting to proximal navigation, by exploiting a distance-field representation of the 3D object. The point-of-interest selector exploits a specialized view similarity computation to propose a few nearby easily reachable interesting 3D views from a large database, move the camera to the user-selected point of interest, and provide extra information through overlaid annotations of the target view. The capabilities of our approach have been demonstrated in a public event attended by thousands of people, which were offered the possibility to explore submillimetric reconstructions of 38 stone statues of the Mont’e Prama Nuragic complex, depicting larger-than-life human figures, and small models of prehistoric Nuraghe (cone-shaped stone towers). A follow-up of this work, using 2.5m-high projection screens, is now included in permanent exhibitions at two Archeological Museums. Results of a thorough user evaluation, involving quantitative and subjective measurements, are discussed.

[1]  Tobias Isenberg,et al.  FI3D: Direct-Touch Interaction for the Exploration of 3D Scientific Visualization Spaces , 2010, IEEE Transactions on Visualization and Computer Graphics.

[2]  Chris North,et al.  Information-rich virtual environments: theory, tools, and research agenda , 2003, VRST '03.

[3]  John F. Hughes,et al.  Indirect mappings of multi-touch input using one and two hands , 2008, CHI.

[4]  Enrico Gobbetti,et al.  A point-based system for local and remote exploration of dense 3D scanned models , 2009, VAST'09.

[5]  Enrico Gobbetti,et al.  Massive-Model Rendering Techniques: A Tutorial , 2007, IEEE Computer Graphics and Applications.

[6]  Enrico Gobbetti,et al.  Technical strategies for massive model visualization , 2008, SPM '08.

[7]  Andrew S. Forsberg,et al.  UniCam—2D gestural camera controls for 3D environments , 1999, SI3D.

[8]  Enrico Gobbetti,et al.  Compression-domain seamless multiresolution visualization of gigantic triangle meshes on mobile devices , 2013, Web3D '13.

[9]  Tsvi Kuflik,et al.  A visitor's guide in an active museum: Presentations, communications, and reflection , 2011, JOCCH.

[10]  Eric A. Wernert,et al.  Constrained 3D navigation with 2D controllers , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[11]  Tobias Isenberg,et al.  A Design Study of Direct‐Touch Interaction for Exploratory 3D Scientific Visualization , 2012, Comput. Graph. Forum.

[12]  Carlos Andújar,et al.  User-interface design for the Ripoll Monastery exhibition at the National Art Museum of Catalonia , 2012, Comput. Graph..

[13]  Laurent Grisoni,et al.  3D positioning techniques for multi-touch displays , 2009, VRST '09.

[14]  M. Sheelagh T. Carpendale,et al.  Integration of 3D Data and Text: The Effects of Text Positioning, Connectivity, and Visual Hints on Comprehension , 2005, INTERACT.

[15]  William Buxton,et al.  The design of a GUI paradigm based on tablets, two-hands, and transparency , 1997, CHI.

[16]  J. Falk,et al.  Learning from Museums: Visitor Experiences and the Making of Meaning , 2000 .

[17]  Chi-Wing Fu,et al.  Multi-touch techniques for exploring large-scale 3D astrophysical simulations , 2010, CHI.

[18]  Laurent Grisoni,et al.  Integrality and Separability of Multitouch Interaction Techniques in 3D Manipulation Tasks , 2012, IEEE Transactions on Visualization and Computer Graphics.

[19]  George W. Fitzmaurice,et al.  Safe 3D navigation , 2008, I3D '08.

[20]  Joaquim A. Jorge,et al.  Agrafo: a visual interface for grouping and browsing digital photos , 2008, AVI '08.

[21]  Pere-Pau Vázquez,et al.  Correlating Text and Images: Concept and Evaluation , 2007, Smart Graphics.

[22]  Jan O. Borchers,et al.  BendDesk: dragging across the curve , 2010, ITS '10.

[23]  Anders Ynnerman,et al.  Multi-Touch Table System for Medical Visualization: Application to Orthopedic Surgery Planning , 2011, IEEE Transactions on Visualization and Computer Graphics.

[24]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[25]  Fotis Sotiropoulos,et al.  Interactive Slice WIM: Navigating and Interrogating Volume Data Sets Using a Multisurface, Multitouch VR Interface , 2012, IEEE Transactions on Visualization and Computer Graphics.

[26]  Ken Shoemake,et al.  ARCBALL: a user interface for specifying three-dimensional orientation using a mouse , 1992 .

[27]  Roberto Scopigno,et al.  Artworks narrating a story: a modular framework for the integrated presentation of three-dimensional and textual contents , 2013, Web3D '13.

[28]  Dinesh Manocha,et al.  Ray-Strips: A Compact Mesh Representation for Interactive Ray Tracing , 2007, 2007 IEEE Symposium on Interactive Ray Tracing.

[29]  Frank M. Shipman,et al.  MediaGLOW: organizing photos in a graph-based workspace , 2009, IUI.

[30]  M. Sheelagh T. Carpendale,et al.  Shallow-depth 3d interaction: design and evaluation of one-, two- and three-touch techniques , 2007, CHI.

[31]  George W. Fitzmaurice,et al.  HoverCam: interactive 3D navigation for proximal object inspection , 2005, I3D '05.

[32]  Paolo Cignoni,et al.  Adaptive tetrapuzzles: efficient out-of-core construction and visualization of gigantic multiresolution polygonal models , 2004, ACM Trans. Graph..

[33]  Sylvie Ranwez,et al.  Visualizing Social Photos on a Hasse Diagram for Eliciting Relations and Indexing New Photos , 2009, IEEE Transactions on Visualization and Computer Graphics.

[34]  Paolo Cignoni,et al.  Virtual Inspector: A Flexible Visualizer for Dense 3D Scanned Models , 2008, IEEE Computer Graphics and Applications.

[35]  Stefan Decker,et al.  Integrating Text with Video and 3D Graphics: The Effects of Text Drawing Styles on Text Readability , 2010, CHI.

[36]  Alistair G. Sutcliffe,et al.  Designing effective multimedia presentations , 1997, CHI.

[37]  Kasper Hornbæk,et al.  Virtual trackballs revisited , 2004, IEEE Transactions on Visualization and Computer Graphics.

[38]  Yonatan Wexler,et al.  Hierarchical photo organization using geo-relevance , 2007, GIS.

[39]  Laurent Grisoni,et al.  Drag'n Go: Simple and fast navigation in virtual environment , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[40]  Philip L. Davidson,et al.  A screen-space formulation for 2D and 3D direct manipulation , 2009, UIST '09.

[41]  Antonio Chica Calaf,et al.  Portalada: a virtual reconstruction of the entrance of the Ripoll Monastery , 2008 .

[42]  George W. Fitzmaurice,et al.  ShowMotion: camera motion based 3D design review , 2006, I3D '06.

[43]  Jean-Baptiste de la Rivière,et al.  CubTile: a multi-touch cubic interface , 2008, VRST '08.

[44]  George Papagiannakis,et al.  A taxonomy of visualization strategies for cultural heritage applications , 2010, JOCCH.

[45]  Tobias Isenberg,et al.  Reimagining the Scientific Visualization Interaction Paradigm , 2013, Computer.

[46]  Dinesh Manocha,et al.  Real-Time Massive Model Rendering , 2008, Real-Time Massive Model Rendering.

[47]  Hwan-Gue Cho,et al.  PHOTOLAND: a new image layout system using spatio-temporal information in digital photos , 2010, SAC '10.

[48]  Hwan-Gue Cho,et al.  A smart clustering algorithm for photo set obtained from multiple digital cameras , 2009, SAC '09.

[49]  Chris North,et al.  The role of Depth and Gestalt cues in information-rich virtual environments , 2011, Int. J. Hum. Comput. Stud..

[50]  Thomas Butkiewicz,et al.  Multi-touch 3D exploratory analysis of ocean flow models , 2011, OCEANS'11 MTS/IEEE KONA.

[51]  Andreas Butz,et al.  Curve: revisiting the digital desk , 2010, NordiCHI.

[52]  Ruggero Pintus,et al.  Mont’e Scan , 2015, ACM Journal on Computing and Cultural Heritage.

[53]  M. Sheelagh T. Carpendale,et al.  Exploring tangible and direct touch interfaces for manipulating 2D and 3D information on a digital table , 2009, ITS '09.

[54]  Enrico Gobbetti,et al.  Natural exploration of 3D massive models on large-scale light field displays using the FOX proximal navigation technique , 2012, Comput. Graph..

[55]  George W. Fitzmaurice,et al.  StyleCam: interactive stylized 3D navigation using integrated spatial & temporal controls , 2002, UIST '02.

[56]  Stefan Decker,et al.  A dual-mode user interface for accessing 3D content on the world wide web , 2012, WWW.

[57]  Patrick Olivier,et al.  Camera control in computer graphics: models, techniques and applications , 2009, SIGGRAPH ASIA Courses.

[58]  Igor Mordatch,et al.  Multiscale 3D navigation , 2009, I3D '09.

[59]  Martin Hachet,et al.  Touch-Based Interfaces for Interacting with 3D Content in Public Exhibitions , 2013, IEEE Computer Graphics and Applications.

[60]  Enrico Gobbetti,et al.  3DNSITE: a networked interactive 3D visualization system to simplify location awareness in crisis management , 2012, Web3D '12.

[61]  Ruggero Pintus,et al.  Improving the digitization of shape and color of 3D artworks in a cluttered environment , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[62]  Martin Hachet,et al.  Multi-touch RST in 2D and 3D spaces: Studying the impact of directness on user performance , 2011, 2011 IEEE Symposium on 3D User Interfaces (3DUI).

[63]  Abigail Sellen,et al.  A study in interactive 3-D rotation using 2-D control devices , 1988, SIGGRAPH.

[64]  Martin Hachet,et al.  A Survey of Interaction Techniques for Interactive 3D Environments , 2013, Eurographics.