Two-Dimensional Non-Line-of-Sight Scene Estimation From a Single Edge Occluder

Passive non-line-of-sight imaging methods are often faster and stealthier than their active counterparts, requiring less complex and costly equipment. However, many of these methods exploit motion of an occluder or the hidden scene, or require knowledge or calibration of complicated occluders. The edge of a wall is a known and ubiquitous occluding structure that may be used as an aperture to image the region hidden behind it. Light from around the corner is cast onto the floor forming a fan-like penumbra rather than a sharp shadow. Subtle variations in the penumbra contain a remarkable amount of information about the hidden scene. Previous work has leveraged the vertical nature of the edge to demonstrate 1D (in angle measured around the corner) reconstructions of moving and stationary hidden scenery from as little as a single photograph of the penumbra. In this work, we introduce a second reconstruction dimension: range measured from the edge. We derive a new forward model, accounting for radial falloff, and propose two inversion algorithms to form 2D reconstructions from a single photograph of the penumbra. Performances of both algorithms are demonstrated on experimental data corresponding to several different hidden scene configurations. A Cramér–Rao bound analysis further demonstrates the feasibility (and utility) of the 2D corner camera.

[1]  Adam L. Cohen Anti-pinhole Imaging , 1982 .

[2]  R. Raskar,et al.  Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging , 2012, Nature Communications.

[3]  Federica Villa,et al.  Non-Line-of-Sight Three-Dimensional Imaging with a Single-Pixel Camera , 2019, Physical Review Applied.

[4]  Marc Teboulle,et al.  A fast Iterative Shrinkage-Thresholding Algorithm with application to wavelet-based image deblurring , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Vivek K. Goyal,et al.  Photon-Efficient Computational 3-D and Reflectivity Imaging With Single-Photon Detectors , 2014, IEEE Transactions on Computational Imaging.

[6]  Vivek K. Goyal,et al.  Diffuse Imaging: Creating Optical Images With Unfocused Time-Resolved Illumination and Sensing , 2012, IEEE Signal Processing Letters.

[7]  Antonio Torralba,et al.  Accidental pinhole and pinspeck cameras: Revealing the scene outside the picture , 2012, CVPR.

[8]  Christos Thrampoulidis,et al.  Using Unknown Occluders to Recover Hidden Scenes , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Jaime Martín,et al.  Tracking objects outside the line of sight using 2D intensity images , 2016, Scientific Reports.

[10]  Hui Guo,et al.  Image contrast model of non-line-of-sight imaging based on laser range-gated imaging , 2013 .

[11]  Diego Gutierrez,et al.  Non-line-of-sight imaging using phasor-field virtual wave optics , 2018, Nature.

[12]  Vivek K. Goyal,et al.  A Few Photons Among Many: Unmixing Signal and Noise for Photon-Efficient Active Imaging , 2016, IEEE Transactions on Computational Imaging.

[13]  Jean-Yves Tourneret,et al.  Seeing around corners with edge-resolved transient imaging , 2020, Nature Communications.

[14]  Kiriakos N. Kutulakos,et al.  The Geometry of First-Returning Photons for Non-Line-of-Sight Imaging , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Frédo Durand,et al.  Turning Corners into Cameras: Principles and Methods , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[16]  Gordon Wetzstein,et al.  Confocal non-line-of-sight imaging based on the light-cone transform , 2018, Nature.

[17]  Martin Laurenzis,et al.  Study of single photon counting for non-line-of-sight vision , 2015, Sensing Technologies + Applications.

[18]  Gordon Wetzstein,et al.  Wave-based non-line-of-sight imaging using fast f-k migration , 2019, ACM Trans. Graph..

[19]  Jeffrey H. Shapiro,et al.  Exploiting Occlusion in Non-Line-of-Sight Active Imaging , 2017, IEEE Transactions on Computational Imaging.

[20]  Charles Saunders,et al.  Computational periscopy with an ordinary digital camera , 2019, Nature.

[21]  Vivek K. Goyal,et al.  Corner Occluder Computational Periscopy: Estimating a Hidden Scene from a Single Photograph , 2019, 2019 IEEE International Conference on Computational Photography (ICCP).

[22]  Robert Henderson,et al.  Detection and tracking of moving objects hidden from view , 2015, Nature Photonics.

[23]  Ramesh Raskar,et al.  Reconstruction of hidden 3D shapes using diffuse reflections , 2012, Optics express.

[24]  Christos Thrampoulidis,et al.  Revealing hidden scenes by photon-efficient occlusion-based opportunistic active imaging. , 2018, Optics express.

[25]  Gregory W. Wornell,et al.  Computational Mirrors: Blind Inverse Light Transport by Deep Matrix Factorization , 2019, NeurIPS.

[26]  Vivek K. Goyal,et al.  Occlusion-based computational periscopy with consumer cameras , 2019, Optical Engineering + Applications.

[27]  Martin Laurenzis,et al.  Transient imaging for real-time tracking around a corner , 2016, Security + Defence.

[28]  Vivek K Goyal,et al.  First-Photon Imaging , 2014, Science.

[29]  Jonathan Leach,et al.  Non-line-of-sight tracking of people at long range , 2017, Optics express.

[30]  Gordon Wetzstein,et al.  Non-line-of-sight Imaging with Partial Occluders and Surface Normals , 2017, ACM Trans. Graph..

[31]  K. Eliceiri,et al.  Non-line-of-sight imaging using a time-gated single photon avalanche diode. , 2015, Optics express.

[32]  Martin Laurenzis,et al.  Study of a dual mode SWIR active imaging system for direct imaging and non-line-of-sight vision , 2015, Defense + Security Symposium.

[33]  Noah Simon,et al.  A Sparse-Group Lasso , 2013 .