Observing using sound and light – a short review of underwater acoustic and video-based methods

Abstract. This paper is a review which briefly describes a selection of acoustic observation techniques and certain aspects of underwater video technology suitable for observations in an underwater environment. The review is divided into two sections, one for each subject, where each section concludes with a discussion of the current challenges within the respective fields. The acoustic section of the review covers bathymetric and geometrical measurements, imaging sonars, subsurface penetrating profilers, positioning methods, acoustic underwater communication and sensor networks, and water speed measurements. The section ends by considering temperature measurements by ocean acoustic tomography and passive acoustic monitoring. The underwater video section initially deals with questions of acquisition including underwater visibility, the type of platform, and video formats, image sensors and specialized cameras. This is followed by notes on processing techniques including mosaicking, stereo video, structured light, recording and transmission, image enhancement techniques and ends with a short discussion of underwater holographic cameras.

[1]  D. C. Hendry,et al.  In Situ Underwater Electronic Holographic Camera for Studies of Plankton , 2007, IEEE Journal of Oceanic Engineering.

[2]  Euan S. Harvey,et al.  Direct sensing of the size frequency and abundance of target and non-target fauna in Australian fisheries - a national workshop, 4-7 September 2000, Rottnest Island, Western Australia , 2001 .

[3]  Yuanyuan Zhao,et al.  Autonomous Underwater Vehicle Navigation , 2010, IEEE Journal of Oceanic Engineering.

[4]  P. H. Milne.  Underwater engineering surveys , 1980 .

[5]  Harry Shum,et al.  Full-frame video stabilization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  A.B. Baggeroer,et al.  The state of the art in underwater acoustic telemetry , 2000, IEEE Journal of Oceanic Engineering.

[7]  J. M. Preston,et al.  Seabed classification of multibeam sonar images , 2001, MTS/IEEE Oceans 2001. An Ocean Odyssey. Conference Proceedings (IEEE Cat. No.01CH37295).

[8]  Stuart Robson,et al.  The accuracy and precision of underwater measurements of length and maximum body depth of southern bluefin tuna (Thunnus maccoyii) with a stereo-video camera system , 2003 .

[9]  Acoustic thermometry in the Arctic Ocean , 2001 .

[10]  X. Lurton,et al.  Maximum swath width obtainable with multibeam echosounders-comparison and discussion of experiments vs predictions , 1998, IEEE Oceanic Engineering Society. OCEANS'98. Conference Proceedings (Cat. No.98CH36259).

[11]  Louis J. Cutrona,et al.  Additional characteristics of synthetic‐aperture sonar systems and a further comparison with nonsynthetic‐aperture sonar systems , 1977 .

[12]  D. C. Hendry,et al.  Underwater digital holography for studies of marine plankton , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[13]  H. G. Thomas,et al.  GIB buoys: an interface between space and depths of the oceans , 1998, Proceedings of the 1998 Workshop on Autonomous Underwater Vehicles (Cat. No.98CH36290).

[14]  A. Quazi,et al.  Underwater acoustic communications , 1982, IEEE Communications Magazine.

[15]  Feng Xiao,et al.  Resolution and light sensitivity tradeoff with pixel size , 2006, Electronic Imaging.

[16]  Euan S. Harvey,et al.  Stereo–video observation of nearshore bedforms on a low energy beach , 2002 .

[17]  Shahriar Negahdaripour,et al.  Theoretical accuracy analysis of N-Ocular vision systems for scene reconstruction, motion estimation, and positioning , 2004 .

[18]  S. M. Doherty,et al.  Seismic Data Analysis: Processing, Inversion, and Interpretation of Seismic Data , 2000 .

[19]  M. Buckingham.  Theory of acoustic attenuation, dispersion, and pulse propagation in unconsolidated granular materials including marine sediments , 1997 .

[20]  Benjamin L. Ochoa,et al.  Development of a New Underwater Bathymetric Laser Imaging System: L-Bath , 2000 .

[21]  Gene L. Stewart,et al.  Application Of Holographic Techniques To The Study Of Marine Plankton In The Field And In The Laboratory , 1974, Optics & Photonics.

[22]  C. Clay,et al.  Acoustical Oceanography : Principles and Applications , 1977 .

[23]  Nathalie Pessel,et al.  Real-time geo-referenced video mosaicking with the MATISSE system , 2003, Oceans 2003. Celebrating the Past ... Teaming Toward the Future (IEEE Cat. No.03CH37492).

[24]  M. Lasky.  Review of undersea acoustics to 1950 , 1977 .

[25]  E. Hamilton.  Geoacoustic modeling of the sea floor , 1980 .

[26]  P. Firoozfam,et al.  An ROV Stereovision System for Ship-Hull Inspection , 2006, IEEE Journal of Oceanic Engineering.

[27]  Robert D. Stoll,et al.  Wave Attenuation in Saturated Sediments , 1970 .

[28]  J.S.M. Rusby,et al.  Long-range sonar mapping of the continental shelf , 1975 .

[29]  L. R. LeBlanc,et al.  Some Applications Of The Chirp Sonar , 1990, Conference Proceedings on Engineering in the Ocean Environment.

[30]  A. Williams.  Current measurement technology development progress in the '90s-a review , 1996, OCEANS 96 MTS/IEEE Conference Proceedings. The Coastal Ocean - Prospects for the 21st Century.

[31]  J. Wiza.  Microchannel plate detectors , 1979 .

[32]  John Perry Fish,et al.  Sound underwater images : a guide to the generation and interpretation of side scan sonar data , 1990 .

[33]  M. B. Larsen,et al.  Synthetic long baseline navigation of underwater vehicles , 2000, OCEANS 2000 MTS/IEEE Conference and Exhibition. Conference Proceedings (Cat. No.00CH37158).

[34]  Mark R. Pickering,et al.  Digital Television: Technology and Standards , 2007 .

[35]  Donna M. Kocak,et al.  The Current Art of Underwater Imaging -- With a Glimpse of the Past and Vision of the Future , 2005 .

[36]  Kendall L. Carder,et al.  In situ holographic measurements of the sizes and settling rates of oceanic particulates , 1982 .

[37]  Stefan B. Williams,et al.  Towards terrain-aided navigation for underwater robotics , 2001, Adv. Robotics.

[38]  Robert C. Spindel,et al.  The Heard Island Feasibility Test , 1992 .

[39]  Walter Munk,et al.  Ocean Acoustic Tomography , 1988 .

[40]  G. Acar,et al.  ACMENet: an underwater acoustic sensor network protocol for real-time environmental monitoring in coastal areas , 2006 .

[41]  Laurie M. Linnett,et al.  Underwater video mosaicing for seabed mapping , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[42]  Y. Doisy.  Theoretical accuracy of Doppler navigation sonars and acoustic Doppler current profilers , 2004, IEEE Journal of Oceanic Engineering.

[43]  C S Johnson,et al.  Sonar target discrimination by instrumented human divers. , 1976, The Journal of the Acoustical Society of America.

[44]  Peter R Hobson,et al.  The principles and practice of holographic recording of plankton , 2002 .

[45]  H. Mitsudera,et al.  Monitoring the Kuroshio Extension with Dynamically Constrained Synthesis of the Acoustic Tomography, Satellite Altimeter and in situ Data , 2003 .

[46]  D.W. Pfitsch,et al.  Development of a free-drifting submersible digital holographic imaging system , 2005, Proceedings of OCEANS 2005 MTS/IEEE.

[47]  M.E. Zakharia,et al.  Combined parametric synthetic and interferometric sonar for the detection of buried objects , 2005, Europe Oceans 2005.

[48]  H. Barnes.  Under-Water Television and Marine Biology , 1952, Nature.

[49]  Paul M. Evans,et al.  New technology for subsea laser imaging and ranging system for inspection and mapping , 1998 .

[50]  A. E. Vigil.  An update on low-light-level camera technology for underwater applications , 1995, 'Challenges of Our Changing Global Environment'. Conference Proceedings. OCEANS '95 MTS/IEEE.

[51]  Automated acoustic classification of sidescan images , 2004, Oceans '04 MTS/IEEE Techno-Ocean '04 (IEEE Cat. No.04CH37600).

[52]  Manfred H. Jericho,et al.  Submersible digital in-line holographic microscope , 2006 .

[53]  Peter Klages,et al.  Digital in-line holographic microscopy. , 2006, Applied optics.

[54]  R. L. Marks,et al.  Improved real-time videomosaicking of the ocean floor , 1995, 'Challenges of Our Changing Global Environment'. Conference Proceedings. OCEANS '95 MTS/IEEE.

[55]  I. Takayanagi,et al.  A 1.25-inch 60-frames/s 8.3-M-pixel digital-output CMOS image sensor , 2005, IEEE Journal of Solid-State Circuits.

[56]  P. H. Milne,et al.  Underwater Acoustic Positioning Systems , 1983 .

[57]  E. Leith,et al.  I Recent Advances in Holography , 1967 .

[58]  Hugh Durrant-Whyte,et al.  Towards Terrain Aided Navigation of a Subsea Vehicle , 1998 .

[59]  A. Trucco,et al.  A holographic system for subsea recording and analysis of plankton and other marine particles (HOLOMAR) , 2003, Oceans 2003. Celebrating the Past ... Teaming Toward the Future (IEEE Cat. No.03CH37492).

[60]  W. Brown.  Synthetic Aperture Radar , 1967, IEEE Transactions on Aerospace and Electronic Systems.

[61]  T. Birdsall,et al.  A decade of acoustic thermometry in the North Pacific Ocean , 2009 .

[62]  D. Martin,et al.  Long-range acoustic detection and tracking of the humpback whale Hawaii-Alaska migration , 1996, OCEANS 96 MTS/IEEE Conference Proceedings. The Coastal Ocean - Prospects for the 21st Century.

[63]  B. Bingham,et al.  Integrating SHARPS II precision navigation into JASON/MEDEA two-vehicle operation , 2005, Proceedings of OCEANS 2005 MTS/IEEE.

[64]  Vinay K. Ingle,et al.  Underwater video compression using the wavelet transform , 1995, 'Challenges of Our Changing Global Environment'. Conference Proceedings. OCEANS '95 MTS/IEEE.

[65]  T. Karlsson.  Terrain Aided Underwater Navigation using Bayesian Statistics , 2002 .

[66]  P. J. Westervelt,et al.  Scattering of Sound by Sound , 1957 .

[67]  Abdul Hamid Sadka.  Compressed Video Communications , 2002 .

[68]  J. Irish,et al.  An Evaluation Of A Bottom-Mounted Doppler Acoustic Profiling Current Meter , 1983, Proceedings OCEANS '83.

[69]  W. Munk.  Ocean Acoustic Tomography: From a Stormy Start to an Uncertain Future , 2006 .

[70]  Dario Pompili,et al.  Underwater acoustic sensor networks: research challenges , 2005, Ad Hoc Networks.

[71]  A. Hay,et al.  A simple system for laser-illuminated video imaging of sediment suspension and bed topography , 1998 .

[72]  T. F. Hueter.  Twenty Years in Underwater Acoustics: Generation and Reception , 1972 .

[73]  Joseph Katz,et al.  Measurements of plankton distribution in the ocean using submersible holography , 1999 .

[74]  Philippe Blondel,et al.  Handbook of seafloor sonar imagery , 1997 .

[75]  Richard O. Nielsen,et al.  Sonar Signal Processing , 1991 .

[76]  H. Hellsten.  CARABAS-an UWB low frequency SAR , 1992, 1992 IEEE Microwave Symposium Digest MTT-S.

[77]  K. Vickery,et al.  Acoustic positioning systems. A practical overview of current systems , 1998, Proceedings of the 1998 Workshop on Autonomous Underwater Vehicles (Cat. No.98CH36290).

[78]  J. Rouvaen,et al.  Scattering of Sound by Sound in Solids , 1973 .

[79]  K. Vickery.  Acoustic positioning systems. New concepts-the future , 1998, Proceedings of the 1998 Workshop on Autonomous Underwater Vehicles (Cat. No.98CH36290).

[80]  Joseph Katz,et al.  Digital holographic microscopy reveals prey-induced changes in swimming behavior of predatory dinoflagellates , 2007, Proceedings of the National Academy of Sciences.

[81]  Justin K. Dix,et al.  Decimeter-resolution 3D seismic volume in shallow water: A case study in small-object detection , 2008 .

[82]  R. T. Beyer,et al.  Experimental Investigation of an End-Fire Array , 1962 .

[83]  Christophe Jean-Michel Basset.  CMOS imaging technology with embedded early image processing , 2007 .

[84]  Ole Arve Misund,et al.  Mapping the shape, size, and density of fish schools by echo integration and a high-resolution sonar , 1995 .

[85]  Shahriar Negahdaripour,et al.  A multi-camera conical imaging system for robust 3D motion estimation, positioning and mapping from UAVs , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[86]  M. Biot.  Theory of Propagation of Elastic Waves in a Fluid‐Saturated Porous Solid. I. Low‐Frequency Range , 1956 .

[87]  Christian J. Kähler,et al.  Comparison of CCD, CMOS and intensified cameras , 2007 .

[88]  D. Gabor.  Microscopy by reconstructed wave-fronts , 1949, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[89]  B. Dushaw.  Another look at the 1960 Perth to Bermuda long‐range acoustic propagation experiment , 2008 .

[90]  B. Dushaw,et al.  Observing the ocean in the 2000s: a strategy for the role of acoustic tomography in ocean climate observation , 2001 .

[91]  G. Appell,et al.  Current velocity measurements using acoustic Doppler backscatter: A review , 1986 .

[92]  Jerry C. Whitaker,et al.  Standard Handbook of Video and Television Engineering , 2003 .

[93]  Carl Wunsch,et al.  Ocean acoustic tomography: a scheme for large scale monitoring , 1979 .

[94]  Shahriar Negahdaripour,et al.  Positioning and photo-mosaicking with long image sequences; comparison of selected methods , 2001, MTS/IEEE Oceans 2001. An Ocean Odyssey. Conference Proceedings (IEEE Cat. No.01CH37295).

[95]  Luca d'Agostino,et al.  Comparison of Holographic and Coulter Counter Measurements of Cavitation Nuclei in the Ocean , 1988 .

[96]  Iain E. G. Richardson,et al.  Video Codec Design: Developing Image and Video Compression Systems , 2002 .

[97]  M. Biot.  Theory of Propagation of Elastic Waves in a Fluid-Saturated Porous Solid. II. Higher Frequency Range , 1956 .

[98]  Barry Ma,et al.  Passive acoustic detection and measurement of rainfall at sea , 2005 .

[99]  Y.Y. Schechner,et al.  Recovery of underwater visibility and structure by polarization analysis , 2005, IEEE Journal of Oceanic Engineering.

[100]  Koji Mori,et al.  A practical spherical mirror omnidirectional camera , 2005, International Workshop on Robotic Sensors: Robotic and Sensor Environments, 2005..

[101]  Joseph Katz,et al.  Submersible holocamera for detection of particle characteristics and motions in the ocean , 1999 .

[102]  D. Codiga,et al.  Networked Acoustic Modems for Real-Time Data Telemetry from Distributed Subsurface Instruments in the Coastal Ocean: Application to Array of Bottom-Mounted ADCPs , 2005 .

[103]  Yuan Li,et al.  Research challenges and applications for underwater sensor networking , 2006, IEEE Wireless Communications and Networking Conference, 2006. WCNC 2006..

[104]  L. Freitag,et al.  High rate acoustic link for underwater video transmission , 2004, Oceans 2003. Celebrating the Past ... Teaming Toward the Future (IEEE Cat. No.03CH37492).

[105]  C Knox,et al.  Holographic Microscopy as a Technique for Recording Dynamic Microscopic Subjects , 1966, Science.

[106]  R. C. Chivers,et al.  An ultrasonic signal processor for use in underwater acoustics , 1985 .

[107]  A. Trucco,et al.  Three-dimensional image generation and processing in underwater acoustic vision , 2000, Proceedings of the IEEE.

[108]  George T. Ioannidis,et al.  Automatic content-based analysis of georeferenced image data: Detection of Beggiatoa mats in seafloor video mosaics from the Håkon Mosby Mud Volcano , 2007, Comput. Geosci..

[109]  Ian A. Meinertzhagen,et al.  Digital in-line holography with photons and electrons , 2001 .

[110]  A. Kaya,et al.  An Acoustic Communication System for Subsea Robot , 1989, Proceedings OCEANS.

[111]  B. A. Swartz.  Laser range gate underwater imaging advances , 1994, Proceedings of OCEANS'94.

[112]  Arthur B. Baggeroer,et al.  The Heard Island papers: A contribution to global acoustics , 1994 .

[113]  Robert J. Urick,et al.  Principles of underwater sound , 1975 .