The Next Best Underwater View

To image in high resolution large and occlusion-prone scenes, a camera must move above and around. Degradation of visibility due to geometric occlusions and distances is exacerbated by scattering, when the scene is in a participating medium. Moreover, underwater and in other media, artificial lighting is needed. Overall, data quality depends on the observed surface, medium and the timevarying poses of the camera and light source (C&L). This work proposes to optimize C&L poses as they move, so that the surface is scanned efficiently and the descattered recovery has the highest quality. The work generalizes the next best view concept of robot vision to scattering media and cooperative movable lighting. It also extends descattering to platforms that move optimally. The optimization criterion is information gain, taken from information theory. We exploit the existence of a prior rough 3D model, since underwater such a model is routinely obtained using sonar. We demonstrate this principle in a scaled-down setup.

[1]  Matthew O'Toole,et al.  Primal-dual coding to probe light transport , 2012, ACM Trans. Graph..

[2]  Bharath Modayur,et al.  Automatic light-source placement for detecting object features , 1992, Other Conferences.

[3]  Mariette Yvinec,et al.  A surface reconstruction method for in-detail underwater 3D optical mapping , 2015, Int. J. Robotics Res..

[4]  Frédo Durand,et al.  Micron-scale light transport decomposition using interferometry , 2015, ACM Trans. Graph..

[5]  Y. Petillot,et al.  A particle filter approach for AUV localization , 2008, OCEANS 2008.

[6]  Wolfgang Heidrich,et al.  Imaging in scattering media using correlation image sensors and sparse convolutional coding. , 2014, Optics express.

[7]  Yoav Y. Schechner,et al.  Illumination Multiplexing within Fundamental Limits , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Hao Zhang,et al.  Bidirectional reflectance study on dry, wet, and submerged particulate layers: effects of pore liquid refractive index and translucent particle concentrations. , 2006, Applied optics.

[9]  Shree K. Nayar,et al.  Acquiring scattering properties of participating media by dilution , 2006, ACM Trans. Graph..

[10]  Franz S. Hover,et al.  Sampling-Based Coverage Path Planning for Inspection of Complex Structures , 2012, ICAPS.

[11]  Yoav Y. Schechner,et al.  In-situ multi-view multi-scattering stochastic tomography , 2016, 2016 IEEE International Conference on Computational Photography (ICCP).

[12]  Richard Pito,et al.  A Solution to the Next Best View Problem for Automated Surface Acquisition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Shengyong Chen,et al.  Vision sensor planning for 3-D model acquisition , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Yoav Y. Schechner,et al.  Active Polarization Descattering , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  E. Coiras,et al.  Simulation and 3D Reconstruction of Side-looking Sonar Images , 2009 .

[16]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[17]  Sajad Saeedi,et al.  AUV Navigation and Localization: A Review , 2014, IEEE Journal of Oceanic Engineering.

[18]  Jan-Michael Frahm,et al.  Developing visual sensing strategies through next best view planning , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  T. Kolda,et al.  A generating set direct search augmented Lagrangian algorithm for optimization with a combination of general and linear constraints , 2006 .

[20]  Peter Shirley,et al.  An Anisotropic Phong BRDF Model , 2000, J. Graphics, GPU, & Game Tools.

[21]  D. V. Gokhale,et al.  Entropy expressions and their estimators for multivariate distributions , 1989, IEEE Trans. Inf. Theory.

[22]  Fraser Dalgleish,et al.  Extended-Range Undersea Laser Imaging: Current Research Status and a Glimpse at Future Technologies , 2013 .

[23]  Frank P. Ferrie,et al.  Autonomous exploration: driven by uncertainty , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Bo Sun,et al.  A practical analytic single scattering model for real time rendering , 2005, ACM Trans. Graph..

[25]  Christian Früh,et al.  Google Street View: Capturing the World at Street Level , 2010, Computer.

[26]  Yoav Y. Schechner,et al.  Turbid Scene Enhancement Using Multi-Directional Illumination Fusion , 2012, IEEE Transactions on Image Processing.

[27]  Franz S. Hover,et al.  Three-dimensional coverage planning for an underwater inspection robot , 2013, Int. J. Robotics Res..

[28]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[29]  Shahriar Negahdaripour,et al.  Stereovision imaging on submersible platforms for 3-D mapping of benthic habitats and sea-floor structures , 2003 .

[30]  Subhashis Banerjee,et al.  Active recognition through next view planning: a survey , 2004, Pattern Recognit..

[31]  Matthew Johnson-Roberson,et al.  Autonomous surface vehicle 3D seafloor reconstruction from monocular images and sonar data , 2015, OCEANS 2015 - MTS/IEEE Washington.

[32]  Joachim Denzler,et al.  An Information Theoretic Approach for Next Best View Planning in 3-D Reconstruction , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[33]  Mohinder Malhotra.  Single Image Haze Removal Using Dark Channel Prior , 2016 .

[34]  Anne Jordt,et al.  Simulating Deep Sea Underwater Images Using Physical Models for Light Attenuation, Scattering, and Refraction , 2011, VMV.

[35]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[36]  Mohit Gupta,et al.  On controlling light transport in poor visibility environments , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Tomomasa Sato,et al.  Automatic planning of light source and camera placement for an active photometric stereo system , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[38]  Donna M. Kocak,et al.  A Focus on Recent Developments and Trends in Underwater Imaging , 2008 .

[39]  David J. Diner,et al.  Spaceborne underwater imaging , 2011, 2011 IEEE International Conference on Computational Photography (ICCP).

[40]  T. Treibitz,et al.  Recovery limits in pointwise degradation , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[41]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  J.S. Jaffe,et al.  Multi Autonomous Underwater Vehicle Optical Imaging for Extended Performance , 2007, OCEANS 2007 - Europe.

[43]  Hanumant Singh,et al.  A Self‐Consistent Bathymetric Mapping Algorithm , 2007, J. Field Robotics.

[44]  Jules S. Jaffe,et al.  Computer modeling and the design of optimal underwater imaging systems , 1990 .

[45]  Yoav Y. Schechner,et al.  The Next Best Underwater View : Supplementary Material , 2016 .

[46]  V. I. Haltrin.  One-parameter two-term Henyey-Greenstein phase function for light scattering in seawater. , 2002, Applied optics.

[47]  Per H. Christensen,et al.  Efficient simulation of light transport in scenes with participating media using photon maps , 1998, SIGGRAPH.

[48]  Matthias Zwicker,et al.  The Beam Radiance Estimate for Volumetric Photon Mapping , 2008, SIGGRAPH '08.

[49]  Ruzena Bajcsy,et al.  Occlusions as a Guide for Planning the Next View , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Geoffrey A. Hollinger,et al.  Uncertainty-driven view planning for underwater inspection , 2012, 2012 IEEE International Conference on Robotics and Automation.

[51]  Kenneth H. Norwich,et al.  Information, sensation, and perception , 1993 .

[52]  O. Pizarro,et al.  Visually Augmented Navigation for Autonomous Underwater Vehicles , 2008, IEEE Journal of Oceanic Engineering.

[53]  K. Mardia,et al.  A review of image-warping methods , 1998 .