Shape from Water: Bispectral Light Absorption for Depth Recovery

This paper introduces a novel depth recovery method based on light absorption in water. Water absorbs light at almost all wavelengths whose absorption coefficient is related to the wavelength. Based on the Beer-Lambert model, we introduce a bispectral depth recovery method that leverages the light absorption difference between two near-infrared wavelengths captured with a distant point source and orthographic cameras. Through extensive analysis, we show that accurate depth can be recovered irrespective of the surface texture and reflectance, and introduce algorithms to correct for nonidealities of a practical implementation, including tilted light source and camera placement and nonideal bandpass filters. We construct a coaxial bispectral depth imaging system using low-cost off-the-shelf hardware and demonstrate its use for recovering the shapes of complex and dynamic objects in water. Experimental results validate the theory and practical implementation of this novel depth recovery paradigm, which we refer to as shape from water.

[1]  Shree K. Nayar,et al.  Structured light in scattering media , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[2]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[3]  Garrett M. Johnson,et al.  Color Imaging: Fundamentals and Applications , 2008 .

[4]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[5]  Shree K. Nayar,et al.  Instant dehazing of images using polarization , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Zlatko Franjcic,et al.  Underwater reconstruction using depth sensors , 2014, SIGGRAPH ASIA Technical Briefs.

[7]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[8]  Radu Horaud,et al.  Time-of-Flight Cameras: Principles, Methods and Applications , 2012 .

[9]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Shree K. Nayar,et al.  Vision and the Atmosphere , 2002, International Journal of Computer Vision.

[12]  Radu Horaud,et al.  Time-of-Flight Cameras , 2012, SpringerBriefs in Computer Science.

[13]  David J. Kriegman,et al.  Photometric Stereo in a Scattering Medium , 2015, ICCV.

[14]  Ko Nishino,et al.  Bayesian Defogging , 2012, International Journal of Computer Vision.

[15]  Ko Nishino,et al.  Factorizing Scene Albedo and Depth from a Single Foggy Image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[16]  Takashi Matsuyama,et al.  3D Shape from Silhouettes in Water for Online Novel-view Synthesis , 2013, IPSJ Trans. Comput. Vis. Appl..

[17]  Joaquim Salvi,et al.  Recent progress in coded structured light as a technique to solve the correspondence problem: a survey , 1998, Pattern Recognit..

[18]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .