Geovisualization with immersive virtual environments in theory and practice

ABSTRACT Virtual reality (VR) is a frequently emphasized issue on the Digital Earth (DE) agenda. While current DE research is more engaged in the technical aspects of VR applications, this paper focuses on what is possible with immersive virtual environments (IVE) from the user's perspective. After a brief discussion of spatial presence and embodiment in the context of IVE, both concepts will be merged into a geovisualization immersion pipeline (GIP) as a framework with which to systematically link technical and cognitive aspects of IVE. We will then analyze the general criteria that must be met by IVE in order to facilitate the experience of spatial presence. Adapting these criteria to the special requirements of geospatial data, a definition of geovisualization immersive virtual environments (GeoIVE) is formulated. Finally, the theoretical considerations of this paper are set into practice, using a GeoIVE of a coral reef ecosystem as an example. As we shall see, while GIS do not provide data models or data compatibility for direct visualization of GeoIVE on VR output devices, game engines can serve as middleware to fill this gap.

[1]  Gary Pettey,et al.  Sounding Out Small Screens and Telepresence , 2010, J. Media Psychol. Theor. Methods Appl..

[2]  Jeremy N. Bailenson,et al.  Experiencing Nature: Embodying Animals in Immersive Virtual Environments Increases Inclusion of Nature in Self and Involvement With Nature , 2016, J. Comput. Mediat. Commun..

[3]  Paul Skalski,et al.  Mapping the road to fun: Natural video game controllers, presence, and game enjoyment , 2011, New Media Soc..

[4]  Huadong Guo,et al.  Next-generation Digital Earth , 2012, Proceedings of the National Academy of Sciences.

[5]  Huadong Guo,et al.  Digital Earth 2020: towards the vision for the next decade , 2012, Int. J. Digit. Earth.

[6]  Alexandru Dancu,et al.  The Ultimate Display , 2014 .

[7]  Steven J. Gortler.  Foundations of 3D Computer Graphics , 2012 .

[8]  John Dilworth,et al.  Realistic virtual reality and perception , 2010 .

[9]  Christoph Klimmt,et al.  Spatial Presence Theory: State of the Art and Challenges Ahead , 2015, Immersed in Media, Telepresence Theory, Measurement & Technology.

[10]  Yvan Bédard,et al.  Visualizing perceived spatial data quality of 3D objects within virtual globes , 2014, Int. J. Digit. Earth.

[11]  Woodrow Barfield,et al.  Presence in virtual environments as a function of type of input device and display update rate , 1998 .

[12]  Carlos Gershenson,et al.  Performance Metrics of Collective Coordinated Motion in Flocks , 2016, ALIFE.

[13]  Adrienne Grêt-Regamey,et al.  Developing a GIS-Based Visual-Acoustic 3D Simulation for Wind Farm Assessment , 2014, ISPRS Int. J. Geo Inf..

[14]  Thomas W. Schubert,et al.  Five Theses on the Book Problem : Presence in Books , Film and VR , 2002 .

[15]  Kwanguk Kim,et al.  Effects of virtual environment platforms on emotional responses , 2014, Comput. Methods Programs Biomed..

[16]  D. Taylor,et al.  A conceptual basis for cartography: new directions for the information era , 1991 .

[17]  Hui Lin,et al.  What's going on about geo-process modeling in virtual geographic environments (VGEs) , 2016 .

[18]  S.M. Harris,et al.  Information Processing , 1977, Nature.

[19]  Rong Li,et al.  Improved Cubemap model for 3D navigation in geo-virtual reality , 2015, Int. J. Digit. Earth.

[20]  Charlene Jennett,et al.  From urban planning and emergency training to Pokémon Go: applications of virtual reality GIS (VRGIS) and augmented reality GIS (ARGIS) in personal, public and environmental health , 2017, International Journal of Health Geographics.

[21]  Bin Jiang,et al.  Cognitive and Usability Issues in Geovisualization , 2001 .

[22]  Michael F. Goodchild,et al.  The use cases of digital earth , 2008, Int. J. Digit. Earth.

[23]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[24]  Maurizio Seracini,et al.  Advanced Applications of Virtual Reality , 2011, Adv. Comput..

[25]  Y. Trope,et al.  Construal Levels and Psychological Distance: Effects on Representation, Prediction, Evaluation, and Behavior. , 2007, Journal of consumer psychology : the official journal of the Society for Consumer Psychology.

[26]  Patrick Olivier,et al.  Camera Control in Computer Graphics , 2008, Comput. Graph. Forum.

[27]  Karen J Reynolds,et al.  Toward Photorealism in Endoscopic Sinus Surgery Simulation , 2013, American journal of rhinology & allergy.

[28]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[29]  R. Aggarwal,et al.  Virtual reality training for surgical trainees in laparoscopic surgery. , 2009, The Cochrane database of systematic reviews.

[30]  Lawrence W. Stark,et al.  The Effects of Pictorial Realism, Delay of Visual Feedback, and Observer Interactivity on the Subjective Sense of Presence , 1996, Presence: Teleoperators & Virtual Environments.

[31]  P. Wesley Schultz,et al.  Perspective Taking, Environmental Concern, and the Moderating Role of Dispositional Empathy , 2007 .

[32]  Matthew Coxon,et al.  Individual differences in virtual reality: Are spatial presence and spatial ability linked? , 2016, Virtual Reality.

[33]  Anne L. Russell.  Nonexpert Conceptions of Virtual Reality. , 1997 .

[34]  A. Gore.  The Digital Earth , 2012 .

[35]  Christoph Klimmt,et al.  The Spatial Presence Experience Scale (SPES) , 2016, J. Media Psychol. Theor. Methods Appl..

[36]  Manfred F. Buchroithner,et al.  The Third Dimension in Cartography: Recent and Future Developments , 2013, KN - Journal of Cartography and Geographic Information.

[37]  Mary C. Whitton,et al.  A Survey of Presence and Related Concepts , 2017, ACM Comput. Surv..

[38]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[39]  Riender Happee,et al.  Effects of visual fidelity on curve negotiation, gaze behaviour and simulator discomfort , 2015, Ergonomics.

[40]  Daniel Casasanto,et al.  When Does Virtual Embodiment Change Our Minds? , 2016, PRESENCE: Teleoperators and Virtual Environments.

[41]  Sven Fuhrmann,et al.  Virtual environments for geographic visualization: potential and challenges , 1999, NPIVM '99.

[42]  Tilo Hartmann,et al.  Ways to Measure Spatial Presence: Review and Future Directions , 2015, Immersed in Media, Telepresence Theory, Measurement & Technology.

[43]  M. J. Kraak,et al.  Cartography: Visualization of Geospatial Data , 1996 .

[44]  A. Banaszak,et al.  Assessment of Acropora palmata in the Mesoamerican Reef System , 2014, PloS one.

[45]  Patrick Olivier,et al.  Camera Control in Computer Graphics , 2006, Eurographics.

[46]  Jeremy N. Bailenson,et al.  How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence , 2016 .

[47]  S. Shyam Sundar,et al.  Where Am I? How Can I Get There? Impact of Navigability and Narrative Transportation on Spatial Presence , 2011, Hum. Comput. Interact..

[48]  Yang Liu,et al.  Review of the development of digital earth research during 1998–2015 based on a bibliometric analysis , 2017, Int. J. Digit. Earth.

[49]  S. Phinn,et al.  Measuring coral reef terrain roughness using 'Structure-from-Motion' close-range photogrammetry , 2015 .

[50]  J. Minton,et al.  Real geographies and virtual landscapes: exploring the influence on place and space on mortality Lexis surfaces using shaded contour maps. , 2014, Spatial and spatio-temporal epidemiology.

[51]  Mark W. Smith,et al.  Structure from Motion in the Geosciences , 2016 .

[52]  D. Delparte,et al.  Distributed under Creative Commons Cc-by 4.0 Integrating Structure-from-motion Photogrammetry with Geospatial Software as a Novel Technique for Quantifying 3d Ecological Characteristics of Coral Reefs , 2022 .

[53]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[54]  John E. Stewart,et al.  Use of Virtual Environments for the Acquisition of Spatial Knowledge: Comparison Among Different , 1999 .

[55]  Hung-Shing Chen,et al.  Visual comfort in autostereoscopic display , 2017 .

[56]  Christoph Klimmt,et al.  A Process Model of the Formation of Spatial Presence Experiences , 2007 .

[57]  A. MacEachren,et al.  Research Challenges in Geovisualization , 2001, KN - Journal of Cartography and Geographic Information.

[58]  Doug A. Bowman,et al.  Virtual Reality: How Much Immersion Is Enough? , 2007, Computer.

[59]  Thomas Heege,et al.  Benthic habitat and bathymetry mapping of shallow waters in Puerto morelos reefs using remote sensing with a physics based data processing , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[60]  P. Schultz.  THE STRUCTURE OF ENVIRONMENTAL CONCERN: CONCERN FOR SELF, OTHER PEOPLE, AND THE BIOSPHERE , 2001 .

[61]  A. Gore.  The digital earth : Understanding our planet in the 21st century , 1998 .