Variable Ring Light Imaging: Capturing Transient Subsurface Scattering with an Ordinary Camera

Subsurface scattering plays a significant role in determining the appearance of real-world surfaces. A light ray penetrating into the subsurface is repeatedly scattered and absorbed by particles along its path before reemerging from the outer interface, which determines its spectral radiance. We introduce a novel imaging method that enables the decomposition of the appearance of a fronto-parallel real-world surface into images of light with bounded path lengths, i.e., transient subsurface light transport. Our key idea is to observe each surface point under a variable ring light: a circular illumination pattern of increasingly larger radius centered on it. We show that the path length of light captured in each of these observations is naturally lower-bounded by the ring light radius. By taking the difference of ring light images of incrementally larger radii, we compute transient images that encode light with bounded path lengths. Experimental results on synthetic and complex real-world surfaces demonstrate that the recovered transient images reveal the subsurface structure of general translucent inhomogeneous surfaces. We further show that their differences reveal the surface colors at different surface depths. The proposed method is the first to enable the unveiling of dense and continuous subsurface structures from steady-state external appearance using ordinary camera and illumination.

[1]  Tian-Tsong Ng,et al.  A Dual Theory of Inverse and Forward Light Transport , 2010, ECCV.

[2]  Wolfgang Heidrich,et al.  Low-budget transient imaging using photonic mixer devices , 2013, ACM Trans. Graph..

[3]  Kiriakos N. Kutulakos,et al.  A theory of inverse light transport , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[4]  Diego Gutierrez,et al.  Femto-photography , 2013, ACM Trans. Graph..

[5]  Diego Gutierrez,et al.  Recent advances in transient imaging: A computer graphics and vision perspective , 2016, Vis. Informatics.

[6]  Ramesh Raskar,et al.  Fast separation of direct and global components of a scene using high frequency illumination , 2006, ACM Trans. Graph..

[7]  Shree K. Nayar,et al.  Multiplexed illumination for scene recovery in the presence of global illumination , 2011, 2011 International Conference on Computer Vision.

[8]  Matthew O'Toole,et al.  Decomposing global light transport using time of flight imaging , 2012, CVPR.

[9]  Yasushi Yagi,et al.  Recovering Inner Slices of Layered Translucent Objects by Multi-Frequency Illumination , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Imari Sato,et al.  Direct and Global Component Separation from a Single Image Using Basis Representation , 2016, ACCV.

[11]  Matthew O'Toole,et al.  Primal-dual coding to probe light transport , 2012, ACM Trans. Graph..

[12]  Dikpal Reddy,et al.  Frequency-Space Decomposition and Acquisition of Light Transport under Spatially Varying Illumination , 2012, ECCV.

[13]  Matthew O'Toole,et al.  3D Shape and Indirect Appearance by Structured Light Transport , 2014, CVPR.

[14]  Shree K. Nayar,et al.  Shedding light on the weather , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[15]  Shree K. Nayar,et al.  AirCode: Unobtrusive Physical Tags for Digital Fabrication , 2017, UIST.

[16]  Matthew O'Toole,et al.  Temporal frequency probing for 5D transient analysis of global light transport , 2014, ACM Trans. Graph..

[17]  Yasushi Yagi,et al.  Analysis of light transport in scattering media , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Matthew O'Toole,et al.  Homogeneous codes for energy-efficient illumination and imaging , 2015, ACM Trans. Graph..

[19]  J. Romberg,et al.  Terahertz time-gated spectral imaging for content extraction through layered structures , 2016, Nature Communications.