Effective Backscatter Approximation for Photometry in Murky Water

Shading-based approaches like Photometric Stereo assume that the image formation model can be effectively optimized for the scene normals. However, in murky water this is a very challenging problem. The light from artificial sources is not only reflected by the scene but it is also scattered by the medium particles, yielding the backscatter component. Backscatter corresponds to a complex term with several unknown variables, and makes the problem of normal estimation hard. In this work, we show that instead of trying to optimize the complex backscatter model or use previous unrealistic simplifications, we can approximate the per-pixel backscatter signal directly from the captured images. Our method is based on the observation that backscatter is saturated beyond a certain distance, i.e. it becomes scene-depth independent, and finally corresponds to a smoothly varying signal which depends strongly on the light position with respect to each pixel. Our backscatter approximation method facilitates imaging and scene reconstruction in murky water when the illumination is artificial as in Photometric Stereo. Specifically, we show that it allows accurate scene normal estimation and offers potentials like single image restoration. We evaluate our approach using numerical simulations and real experiments within both the controlled environment of a big water-tank and real murky port-waters.

[1]  S. Negahdaripour,et al.  3-D shape recovery of planar and curved surfaces from shading cues in underwater images , 2002 .

[2]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Shree K. Nayar,et al.  A practical analytic single scattering model for real time rendering , 2005, SIGGRAPH '05.

[4]  D. Richard Blidberg,et al.  Photometric stereo using point light sources , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[5]  Maria E. Angelopoulou,et al.  Backscatter Compensated Photometric Stereo with 3 Sources , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Yoav Y. Schechner,et al.  Clear underwater vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[7]  Sharriar Negahdaripour,et al.  Investigation of photometric stereo method for 3-D shape recovery from underwater imagery , 2002, OCEANS '02 MTS/IEEE.

[8]  Ying-Ching Chen,et al.  Underwater Image Enhancement by Wavelength Compensation and Dehazing , 2012, IEEE Transactions on Image Processing.

[9]  Mohit Gupta,et al.  On controlling light transport in poor visibility environments , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Hanumant Singh,et al.  Visually Mapping the RMS Titanic: Conservative Covariance Estimates for SLAM Information Filters , 2006, Int. J. Robotics Res..

[11]  Mark J. Warshawsky,et al.  A Modern Approach , 2005 .

[12]  S. Nayar,et al.  Contrast restoration of weather degraded images , 2008, SIGGRAPH 2008.

[13]  Shree K. Nayar,et al.  Structured light in scattering media , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[14]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[15]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Yoav Y. Schechner,et al.  Turbid Scene Enhancement Using Multi-Directional Illumination Fusion , 2012, IEEE Transactions on Image Processing.

[17]  W. S. Jagger,et al.  Aquatic vision and the modulation transfer properties of unlighted and diffusely lighted natural waters , 1993, Vision Research.

[18]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Gabriel Oliver,et al.  A particle filter-based approach for tracking undersea narrow telecommunication cables , 2011, Machine Vision and Applications.

[20]  John P. Oakley,et al.  Correction of Simple Contrast Loss in Color Images , 2007, IEEE Transactions on Image Processing.

[21]  Halleh Mortazavi Mitigation of contrast loss in underwater images , 2010 .

[22]  Yoav Y. Schechner,et al.  Instant 3Descatter , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[23]  Jules S. Jaffe,et al.  Computer modeling and the design of optimal underwater imaging systems , 1990 .

[24]  S Negahdaripour,et al.  Performance assessment in solving the correspondence problem in underwater stereo imagery , 2010, OCEANS 2010 MTS/IEEE SEATTLE.

[25]  D. Kriegman,et al.  Wide field-of-view daytime fluorescence imaging of coral reefs , 2013, 2013 OCEANS - San Diego.

[26]  David J. Kriegman,et al.  Photometric Stereo in a Scattering Medium , 2015, ICCV.

[27]  Yasuyuki Matsushita,et al.  Calibrating a Non-isotropic Near Point Light Source Using a Plane , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Tae-Kyun Kim,et al.  Model effectiveness prediction and system adaptation for photometric stereo in murky water , 2016, Computer Vision and Image Understanding.

[29]  Y.Y. Schechner,et al.  Recovery of underwater visibility and structure by polarization analysis , 2005, IEEE Journal of Oceanic Engineering.

[30]  Yoav Y. Schechner,et al.  Active Polarization Descattering , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.