Decomposing global light transport using time of flight imaging

Global light transport is composed of direct and indirect components. In this paper, we take the first steps toward analyzing light transport using high temporal resolution information via time of flight (ToF) images. The time profile at each pixel encodes complex interactions between the incident light and the scene geometry with spatially-varying material properties. We exploit the time profile to decompose light transport into its constituent direct, subsurface scattering, and interreflection components. We show that the time profile is well modelled using a Gaussian function for the direct and interreflection components, and a decaying exponential function for the subsurface scattering component. We use our direct, subsurface scattering, and interreflection separation algorithm for four computer vision applications: recovering projective depth maps, identifying subsurface scattering objects, measuring parameters of analytical subsurface scattering models, and performing edge detection using ToF images.

[1]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[2]  Jyh-Ming Lien.  Point-Based Minkowski Sum Boundary , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[3]  Wolfgang Heidrich,et al.  Low-budget transient imaging using photonic mixer devices , 2013, ACM Trans. Graph..

[4]  Yasuyuki Matsushita,et al.  Shape from Second-Bounce of Light Transport , 2010, ECCV.

[5]  Hans-Peter Seidel,et al.  Polarization and Phase-Shifting for 3D Scanning of Translucent Objects , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Gordon Wetzstein,et al.  Radiometric Compensation through Inverse Light Transport , 2007 .

[7]  Yasushi Yagi,et al.  Analysis of light transport in scattering media , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Chunxi Zhang,et al.  Ultrafast ranging lidar based on real-time Fourier transformation. , 2009, Optics letters.

[9]  Tian-Tsong Ng,et al.  From the Rendering Equation to Stratified Light Transport Inversion , 2011, International Journal of Computer Vision.

[10]  Diego Gutierrez,et al.  Relativistic ultrafast rendering using time-of-flight imaging , 2012, SIGGRAPH Talks.

[11]  Tian-Tsong Ng,et al.  A Dual Theory of Inverse and Forward Light Transport , 2010, ECCV.

[12]  James C. Wyant,et al.  White light interferometry , 2002, SPIE Defense + Commercial Sensing.

[13]  Shree K. Nayar,et al.  Projection defocus analysis for scene capture and image display , 2006, SIGGRAPH 2006.

[14]  G. Brooker.  Introduction to Sensors for Ranging and Imaging , 2009 .

[15]  Kiriakos N. Kutulakos,et al.  A theory of inverse light transport , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[16]  J. Fujimoto,et al.  Optical Coherence Tomography , 1991, LEOS '92 Conference Proceedings.

[17]  J. Busck,et al.  Gated viewing and high-accuracy three-dimensional laser radar. , 2004, Applied optics.

[18]  Lihong V. Wang,et al.  Biomedical Optics: Principles and Imaging , 2007 .

[19]  R. Raskar,et al.  Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging , 2012, Nature Communications.

[20]  Ashok Veeraraghavan,et al.  Structured light 3D scanning in the presence of global illumination , 2011, CVPR 2011.

[21]  Yuandong Tian,et al.  (De) focusing on global light transport for active scene recovery , 2009, CVPR.

[22]  Benjamin Göhler,et al.  Advanced short-wavelength infrared range-gated imaging for ground applications in monostatic and bistatic configurations. , 2009, Applied optics.

[23]  Marc Levoy,et al.  Dual photography , 2005, SIGGRAPH 2005.

[24]  Ramesh Raskar,et al.  Reconstruction of hidden 3D shapes using diffuse reflections , 2012, Optics express.

[25]  Diego Gutierrez,et al.  Femto-photography , 2013, ACM Trans. Graph..

[26]  Ramesh Raskar,et al.  Estimating Motion and size of moving non-line-of-sight objects in cluttered environments , 2011, CVPR 2011.

[27]  J. Fujimoto,et al.  Optical Coherence Tomography , 1991 .

[28]  Ramesh Raskar,et al.  Single view reflectance capture using multiplexed scattering and time-of-flight imaging , 2011, SA '11.

[29]  Dikpal Reddy,et al.  Frequency-Space Decomposition and Acquisition of Light Transport under Spatially Varying Illumination , 2012, ECCV.

[30]  Todd E. Zickler,et al.  A coaxial optical scanner for synchronous acquisition of 3D geometry and surface reflectance , 2010, SIGGRAPH 2010.

[31]  Matthew O'Toole,et al.  Primal-dual coding to probe light transport , 2012, ACM Trans. Graph..

[32]  N. Abramson.  Light-in-flight recording by holography. , 1978, Optics letters.

[33]  Qionghai Dai,et al.  Frequency Analysis of Transient Light Transport with Applications in Bare Sensor Imaging , 2012, ECCV.

[34]  Ramesh Raskar,et al.  Fast separation of direct and global components of a scene using high frequency illumination , 2006, SIGGRAPH 2006.

[35]  Anthony D. Gleckler.  Multiple-slit streak tube imaging lidar (MS-STIL) applications , 2000, Defense, Security, and Sensing.