Photometric Stereo in a Scattering Medium

Photometric stereo is widely used for 3D reconstruction. However, its use in scattering media such as water, biological tissue and fog has been limited until now, because of forward scattered light from both the source and object, as well as light scattered back from the medium (backscatter). Here we make three contributions to address the key modes of light propagation, under the common single scattering assumption for dilute media. First, we show through extensive simulations that single-scattered light from a source can be approximated by a point light source with a single direction. This alleviates the need to handle light source blur explicitly. Next, we model the blur due to scattering of light from the object. We measure the object point-spread function and introduce a simple deconvolution method. Finally, we show how imaging fluorescence emission where available, eliminates the backscatter component and increases the signal-to-noise ratio. Experimental results in a water tank, with different concentrations of scattering media added, show that deconvolution produces higher-quality 3D reconstructions than previous techniques, and that when combined with fluorescence, can produce results similar to that in clear water even for highly turbid media.

[1]  Shree K. Nayar,et al.  Acquiring scattering properties of participating media by dilution , 2006, ACM Trans. Graph..

[2]  Sharriar Negahdaripour,et al.  Investigation of photometric stereo method for 3-D shape recovery from underwater imagery , 2002, OCEANS '02 MTS/IEEE.

[3]  Rama Chellappa,et al.  What Is the Range of Surface Reconstructions from a Gradient Field? , 2006, ECCV.

[4]  Byungil Kim,et al.  Depth and shape from shading using the photometric stereo method , 1991, CVGIP Image Underst..

[5]  V. Tuchin Tissue Optics: Light Scattering Methods and Instruments for Medical Diagnosis , 2000 .

[6]  Yoav Y. Schechner,et al.  Active Polarization Descattering , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Takahiro Okabe,et al.  Bispectral photometric stereo based on fluorescence , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  L. C. Henyey,et al.  Diffuse radiation in the Galaxy , 1940 .

[9]  M. Carreras,et al.  Mapping the Moon: Using a lightweight AUV to survey the site of the 17th century ship ‘La Lune’ , 2013, 2013 MTS/IEEE OCEANS - Bergen.

[10]  Yoav Y Schechner,et al.  Resolution loss without imaging blur. , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Shree K. Nayar,et al.  A practical analytic single scattering model for real time rendering , 2005, SIGGRAPH '05.

[12]  S. Negahdaripour,et al.  3-D shape recovery of planar and curved surfaces from shading cues in underwater images , 2002 .

[13]  Bo Dong,et al.  Scattering Parameters and Surface Normals from Homogeneous Translucent Materials Using Photometric Stereo , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Shree K. Nayar,et al.  Structured light in scattering media , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[15]  Nahum Kiryati,et al.  Photometric stereo under perspective projection , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[16]  H. Seidel,et al.  Fluorescent immersion range scanning , 2008, ACM Trans. Graph..

[17]  Jules S. Jaffe,et al.  Computer modeling and the design of optimal underwater imaging systems , 1990 .

[18]  David J. Kriegman,et al.  Photometric Stereo in a Scattering Medium , 2015, ICCV.

[19]  Yasushi Yagi,et al.  Recovering inner slices of translucent objects by multi-frequency illumination , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  A. Shashua Geometry and Photometry in 3D Visual Recognition , 1992 .

[21]  D. Richard Blidberg,et al.  Photometric stereo using point light sources , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[22]  Maria E. Angelopoulou,et al.  Backscatter Compensated Photometric Stereo with 3 Sources , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Mohit Gupta,et al.  On controlling light transport in poor visibility environments , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Shree K. Nayar,et al.  Shedding light on the weather , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[25]  Ruggero Pintus,et al.  An Automatic Alignment Procedure for a Four-Source Photometric Stereo Technique Applied to Scanning Electron Microscopy , 2008, IEEE Transactions on Instrumentation and Measurement.

[26]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[27]  Yasushi Yagi,et al.  Surface Normal Deconvolution: Photometric Stereo for Optically Thick Translucent Objects , 2014, ECCV.

[28]  Mauricio Galo,et al.  Surface reconstruction using multiple light sources and perspective projection , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[29]  Yuji Iwahori,et al.  Reconstructing shape from shading images under point light source illumination , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[30]  E. Trucco,et al.  Self-Tuning Underwater Image Restoration , 2006, IEEE Journal of Oceanic Engineering.

[31]  B. L. McGlamery,et al.  A Computer Model For Underwater Camera Systems , 1980, Other Conferences.

[32]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[33]  Richard Szeliski,et al.  PSF estimation using sharp edge prediction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  C.-C. Jay Kuo,et al.  Shape from Photometric Ratio and Stereo , 1996, J. Vis. Commun. Image Represent..

[35]  Donna M. Kocak,et al.  A Focus on Recent Developments and Trends in Underwater Imaging , 2008 .

[36]  David J. Kriegman,et al.  Shape from Fluorescence , 2012, ECCV.