Linear systems approach to identifying performance bounds in indirect imaging

Light scattering on diffuse rough surfaces was long assumed to destroy geometry and photometry information about hidden (non line of sight) objects making ‘looking around the corner’ (LATC) and ‘non line of sight’ (NLOS) imaging impractical. Recent work pioneered by Kirmani et al. [1], Velten et al. [2] demonstrated that transient information (time of flight information) from these scattered third bounce photons can be exploited to solve LATC and NLOS imaging. In this paper, we quantify the geometric and photometric reconstruction limits of LATC and NLOS imaging for the first time using a classical linear systems approach. The relationship between the albedo of the voxels in a hidden volume to the third bounce measurements at the sensor is a linear system that is determined by the geometry and the illumination source. We study this linear system and employ empirical techniques to find the limits of the information contained in the third bounce photons as a function of various system parameters.

[1]  O. Katz,et al.  Looking around corners and through thin turbid layers in real time with scattered incoherent light , 2012, Nature Photonics.

[2]  J. Fujimoto,et al.  Femtosecond optical ranging in biological systems. , 1986, Optics letters.

[3]  Ramesh Raskar,et al.  Looking around the corner using transient imaging , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  N. Abramson.  Light-in-flight recording: high-speed holographic motion pictures of ultrafast phenomena. , 1983, Applied optics.

[5]  Scott A. Basinger,et al.  Optics of a granular imaging system (i.e. “orbiting rainbows”) , 2015, SPIE Optical Engineering + Applications.

[6]  Yasuhiro Awatsuji,et al.  Light-in-Flight Recording by Holographic Microscope and Its Numerical Verification , 2009 .

[7]  Rafael Piestun,et al.  Super-resolution photoacoustic imaging through a scattering wall. , 2015, Nature communications.

[8]  Shlomo Shamai,et al.  Mutual information and minimum mean-square error in Gaussian channels , 2004, IEEE Transactions on Information Theory.

[9]  Shree K. Nayar,et al.  Multiplexing for Optimal Lighting , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Frédo Durand,et al.  Capturing the human figure through a wall , 2015, ACM Trans. Graph..

[11]  Stephen D. Liang,et al.  Sense-through-wall human detection based on UWB radar sensors , 2016, Signal Process..

[12]  Puxiang Lai,et al.  Photoacoustically guided wavefront shaping for enhanced optical focusing in scattering media , 2014, Nature Photonics.

[13]  R. Raskar,et al.  Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging , 2012, Nature Communications.

[14]  K. Eliceiri,et al.  Non-line-of-sight imaging using a time-gated single photon avalanche diode. , 2015, Optics express.

[15]  Matthew O'Toole,et al.  Temporal frequency probing for 5D transient analysis of global light transport , 2014, ACM Trans. Graph..

[16]  Wolfgang Heidrich,et al.  Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination Using Inexpensive Time-of-Flight Sensors , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Martin Laurenzis,et al.  Study of single photon counting for non-line-of-sight vision , 2015, Sensing Technologies + Applications.

[18]  I. Freund.  Looking through walls and around corners , 1990 .

[19]  Vivek K. Goyal,et al.  Diffuse Imaging: Creating Optical Images With Unfocused Time-Resolved Illumination and Sensing , 2012, IEEE Signal Processing Letters.

[20]  Ramesh Raskar,et al.  Occluded Imaging with Time-of-Flight Sensors , 2016, ACM Trans. Graph..

[21]  N. Abramson.  Light-in-flight recording by holography. , 1978, Optics letters.