Improved range estimation and underwater image enhancement under turbidity by opti-acoustic stereo imaging

Images recorded in turbid waters suffer from various forms of signal degradation due to light absorption, scattering and backscatter. Much of the earlier work to enhance color, contrast and sharpness follow the single-image dehazing approach from the atmospheric imaging literature. Requiring knowledge of both range to scene objects and ambient lighting, various techniques differ in how they estimate the information from various image regions. Moreover, some assumptions are made that hold for most images recorded in air and clear waters, but are often violated in turbid environments, leading to poor results. Alternatively, stereo imaging and polarization have been explored for simultaneous range estimating and image dehazing, however, these can become ineffective with low visibility and (or) weak polarization cue. This work explores a methodology that utilizes the visual cues in multi-modal optical and sonar images, namely, the occluding contours of various scene objects that can be detected and matched more robustly than point features. Calculating the sparse 3-D positions of these contours from opti-acosutic stereo data, we infer a dense range map by exploiting an MRF-based statistical framework, where image intensities and range values serve as observation and hidden variables. Additionally, the opti-acoustic epipolar geometry guides the inference of the MRF by refining neighborhood pixels. The improved performance over other state-of-the-art techniques is demonstrated using images recorded under different turbidity conditions.

[1]  Shahriar Negahdaripour,et al.  Opti-Acoustic Stereo Imaging: On System Calibration and 3-D Target Reconstruction , 2009, IEEE Transactions on Image Processing.

[2]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Shahriar Negahdaripour,et al.  Enhancing images in scattering media utilizing stereovision and polarization , 2009, 2009 Workshop on Applications of Computer Vision (WACV).

[4]  Ling Shao,et al.  Single Image Dehazing Using Color Attenuation Prior , 2014, BMVC.

[5]  Shahriar Negahdaripour Epipolar Geometry of Opti-Acoustic Stereo Imaging , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  N Carlevaris-Bianco,et al.  Initial results in underwater single image dehazing , 2010, OCEANS 2010 MTS/IEEE SEATTLE.

[7]  S. Negahdaripour,et al.  3-D motion and structure estimation for arbitrary scenes from 2-D optical and sonar video , 2008, OCEANS 2008.

[8]  Ying-Ching Chen,et al.  Underwater Image Enhancement by Wavelength Compensation and Dehazing , 2012, IEEE Transactions on Image Processing.

[9]  Konrad Schindler,et al.  Detection- and Trajectory-Level Exclusion in Multiple Object Tracking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Gregory Dudek,et al.  Range synthesis for 3D environment modeling , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[11]  Shahriar Negahdaripour,et al.  Improved Stereo Matching in Scattering Media by Incorporating a Backscatter Cue , 2014, IEEE Transactions on Image Processing.

[12]  Raanan Fattal Single image dehazing , 2008, SIGGRAPH 2008.

[13]  Ke Lu,et al.  Single image dehazing with a physical model and dark channel prior , 2015, Neurocomputing.

[14]  Shree K. Nayar,et al.  Instant dehazing of images using polarization , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[15]  Gerhard Rigoll,et al.  Exploiting gradient histograms for gait-based person identification , 2013, 2013 IEEE International Conference on Image Processing.

[16]  Charless C. Fowlkes,et al.  Globally-optimal greedy algorithms for tracking a variable number of objects , 2011, CVPR 2011.

[17]  John Hannah,et al.  IEEE International Conference on Image Processing (ICIP) , 1997 .

[18]  Konrad Schindler,et al.  Discrete-continuous optimization for multi-target tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Gaofeng Meng,et al.  Efficient Image Dehazing with Boundary Constraint and Contextual Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[21]  L. Prieur,et al.  An optical classification of coastal and oceanic waters based on the specific spectral absorption curves of phytoplankton pigments, dissolved organic matter, and other particulate materials1 , 1981 .

[22]  Ko Nishino,et al.  Factorizing Scene Albedo and Depth from a Single Foggy Image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[23]  Pascal Fua,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Multiple Object Tracking Using K-shortest Paths Optimization , 2022 .

[24]  Shahriar Negahdaripour,et al.  3-D object modeling from 2-D occluding contour correspondences by opti-acoustic stereo imaging , 2015, Comput. Vis. Image Underst..

[25]  Huimin Lu,et al.  Underwater image enhancement using guided trigonometric bilateral filter and fast automatic color correction , 2013, 2013 IEEE International Conference on Image Processing.

[26]  Jian Sun,et al.  Single image haze removal using dark channel prior , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Shaogang Gong,et al.  Gait recognition using Gait Entropy Image , 2009, ICDP.

[28]  H.-Y. Yang,et al.  Weighted haze removal method with halo prevention , 2014, J. Vis. Commun. Image Represent..

[29]  Daniel Wolf,et al.  Hypergraphs for Joint Multi-view Reconstruction and Multi-object Tracking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Shahriar Negahdaripour,et al.  3-D motion estimation by integrating visual cues in 2-D multi-modal opti-acoustic stereo sequences , 2010, Comput. Vis. Image Underst..

[31]  James Nga-Kwok Liu,et al.  Gait flow image: A silhouette-based gait representation for human identification , 2011, Pattern Recognit..

[32]  Ivan Laptev,et al.  On pairwise costs for network flow multi-object tracking , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Gregory Dudek,et al.  Inter-Image Statistics for 3D Environment Modeling , 2008, International Journal of Computer Vision.