Virtual Reality and Oceanography: Overview, Applications, and Perspective

With the ongoing, exponential increase in ocean data from autonomous platforms, satellites, models, and in particular, the growing field of quantitative imaging, there arises a need for scalable and cost-efficient visualization tools to interpret these large volumes of data. With the recent proliferation of consumer grade head-mounted displays, the emerging field of virtual reality (VR) has demonstrated its benefit in numerous disciplines, ranging from medicine to archaeology. However, these benefits have not received as much attention in the ocean sciences. Here, we summarize some of the ways that virtual reality has been applied to this field. We highlight a few examples in which we (the authors) demonstrate the utility of VR as a tool for ocean scientists. For oceanic datasets that are well-suited for three-dimensional visualization, virtual reality has the potential to enhance the practice of ocean science.

[1]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[2]  Bunji Shigematsu,et al.  Development of a Deep-Water Topological Survey System Using a Laser Scanner with a GPS , 1997 .

[3]  Jean-Yves Didier,et al.  Distributed mixed reality for remote underwater telerobotics exploration , 2012, VRIC '12.

[4]  Robert Pinkel,et al.  Wirewalker: An Autonomous Wave-Powered Vertical Profiler , 2001 .

[5]  Gabriel Oliver,et al.  Optical Sensors and Methods for Underwater 3D Reconstruction , 2015, Sensors.

[6]  Graham R. Brookes,et al.  Visualizing Underwater Environments Using Multifrequency Sonar , 1999, IEEE Computer Graphics and Applications.

[7]  Brian Lynch,et al.  Efficient Control of an AUV-Manipulator System: An Application for the Exploration of Europa , 2014, IEEE Journal of Oceanic Engineering.

[8]  Huaxiang Cai,et al.  Iterative Learning Control with Extended State Observer for Telescope System , 2015 .

[9]  Jian Gao,et al.  Digital holography reconstruction algorithms to estimate the morphology and depth of nonspherical absorbing particles , 2012, Other Conferences.

[10]  Jules S. Jaffe,et al.  The Sub Sea Holodeck: A 14-megapixel immersive virtual environment for studying cephalopod camouflage behavior , 2011, OCEANS 2011 IEEE - Spain.

[11]  Jin Sung Choi,et al.  Immersive virtual aquarium with real-walking navigation , 2013, VRCAI '13.

[12]  Asgeir J. Sørensen,et al.  HMD as a new tool for telepresence in underwater operations and closed-loop control of ROVs , 2015, OCEANS 2015 - MTS/IEEE Washington.

[13]  P. Girguis,et al.  Advancing Ocean Science and Exploration through Telepresence , 2018 .

[14]  A. Vesterdal [True colors]. , 1989, Sygeplejersken.

[15]  Chintan A. Trivedi,et al.  Visually driven chaining of elementary swim patterns into a goal-directed motor sequence: a virtual reality study of zebrafish prey capture , 2013, Front. Neural Circuits.

[16]  Tom Kwasnitschka,et al.  Doing fieldwork on the seafloor: Photogrammetric techniques to yield 3D visual models from ROV video , 2013, Comput. Geosci..

[17]  Andrea Trucco,et al.  From 3-D Sonar Images to Augmented Reality Models for Objects Buried on the Seafloor , 2008, IEEE Transactions on Instrumentation and Measurement.

[18]  Kelly P. Gaither,et al.  Interactive visualization of ocean circulation models , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[19]  John R. Beers,et al.  A PERMANENT RECORD OF PLANKTON SAMPLES USING HOLOGRAPHY1 , 1970 .

[20]  Caroline Stefani,et al.  ConfocalVR: Immersive Visualization for Confocal Microscopy. , 2018, Journal of molecular biology.

[21]  Hazar A. İlhan,et al.  Digital holographic microscopy and focusing methods based on image sharpness , 2014, Journal of microscopy.

[22]  Samir Otmane,et al.  Augmented reality for underwater activities with the use of the DOLPHYN , 2013, 2013 10th IEEE INTERNATIONAL CONFERENCE ON NETWORKING, SENSING AND CONTROL (ICNSC).

[23]  Zahira Merchant,et al.  Effectiveness of virtual reality-based instruction on students' learning outcomes in K-12 and higher education: A meta-analysis , 2014, Comput. Educ..

[24]  Akira Kageyama,et al.  Scientific visualization of geophysical simulation data by the CAVE VR system with volume rendering , 2007 .

[25]  Leif Oppermann,et al.  Playing on AREEF: evaluation of an underwater augmented reality game for kids , 2016, MobileHCI.

[26]  Prabhat,et al.  Virtual Reality-Based Interactive Scientific Visualization Environments , 2009 .

[27]  Sachit Butail,et al.  Putting the fish in the fish tank: Immersive VR for animal behavior experiments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[28]  Qingping Lin,et al.  A virtual environment-based system for the navigation of underwater robots , 2005, Virtual Reality.

[29]  Rüdiger Westermann,et al.  Visualization in Meteorology—A Survey of Techniques and Tools for Data Analysis Tasks , 2018, IEEE Transactions on Visualization and Computer Graphics.

[30]  Davide Castelvecchi,et al.  Low-cost headsets boost virtual reality’s lab appeal , 2016, Nature.

[31]  Stephen M. Rock,et al.  Underwater vehicle control from a virtual environment interface , 1995, I3D '95.

[32]  Bo Li,et al.  Design and implementation of a 3D ocean virtual reality and visualization engine , 2012, Journal of Ocean University of China.

[33]  David Matthews,et al.  Virtual-reality applications give science a new dimension , 2018, Nature.

[34]  H. Kreuzer,et al.  Holographic Microscopy of Marine Organisms , 2013 .

[35]  Guilhem Marre,et al.  Monitoring Marine Habitats With Photogrammetry: A Cost-Effective, Accurate, Precise and High-Resolution Reconstruction Method , 2019, Front. Mar. Sci..

[36]  Torsten Fröhlich,et al.  The virtual oceanarium , 2000, CACM.

[37]  Chao Liu,et al.  Big data challenges in ocean observation: a survey , 2017, Personal and Ubiquitous Computing.

[38]  Bernd Fröhlich,et al.  Implementing Multi-Viewer Stereo Displays , 2005, WSCG.

[39]  M. Shortisa,et al.  of the Status and Trends in Underwater Videometric Measurement , 2007 .

[40]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[41]  A. Lucas,et al.  Using Bio-Optics to Reveal Phytoplankton Physiology from a Wirewalker Autonomous Platform , 2017 .

[42]  Bernd Hamann,et al.  A geoscience perspective on immersive 3D gridded data visualization , 2008, Comput. Geosci..

[43]  John Quarles,et al.  Towards usable underwater virtual reality systems , 2017, 2017 IEEE Virtual Reality (VR).

[44]  Edin Omerdic,et al.  Underwater manipulators: A review , 2018, Ocean Engineering.

[45]  Carol R. Stoker,et al.  The Application of Telepresence and Virtual Reality to Subsea Exploration , 1994 .

[46]  Lifei Wei,et al.  Modeling and Analysis in Marine Big Data: Advances and Challenges , 2015 .

[47]  Noam Josef,et al.  Cephalopod Experimental Projected Habitat (CEPH): Virtual Reality for Underwater Organisms , 2018, Front. Mar. Sci..

[48]  Carol R. Stoker,et al.  Antarctic Undersea Exploration Using a Robotic Submarine with a Telepresence User Interface , 1995, IEEE Expert.

[49]  A Review of the Status and Trends of Exported Ornamental Fish Resources and Their Habitats in Sri Lanka , 2004 .

[50]  Hugh Griffiths,et al.  Interferometric Synthetic Aperture Sonar , 2000 .

[51]  K. Thyng,et al.  True Colors of Oceanography: Guidelines for Effective and Accurate Colormap Selection , 2016 .

[52]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[53]  Tara Sharma,et al.  Visualizing Our Options for Coastal Places: Exploring Realistic Immersive Geovisualizations as Tools for Inclusive Approaches to Coastal Planning and Management , 2017, Front. Mar. Sci..

[54]  R. Bowen Loftin,et al.  Application of virtual reality in the interpretation of geoscience data , 1998, VRST '98.

[55]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.