Turning Corners into Cameras: Principles and Methods

We show that walls, and other obstructions with edges, can be exploited as naturally-occurring “cameras” that reveal the hidden scenes beyond them. In particular, we demonstrate methods for using the subtle spatio-temporal radiance variations that arise on the ground at the base of a wall's edge to construct a one-dimensional video of the hidden scene behind the wall. The resulting technique can be used for a variety of applications in diverse physical settings. From standard RGB video recordings, we use edge cameras to recover 1-D videos that reveal the number and trajectories of people moving in an occluded scene. We further show that adjacent wall edges, such as those that arise in the case of an open doorway, yield a stereo camera from which the 2-D location of hidden, moving objects can be recovered. We demonstrate our technique in a number of indoor and outdoor environments involving varied floor surfaces and illumination conditions.

[1]  Ramesh Raskar,et al.  Occluded Imaging with Time-of-Flight Sensors , 2016, ACM Trans. Graph..

[2]  R. Raskar,et al.  Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging , 2012, Nature Communications.

[3]  Vivek K. Goyal,et al.  Computational 3D and reflectivity imaging with high photon efficiency , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[4]  Fadel Adib,et al.  See through walls with WiFi! , 2013, SIGCOMM.

[5]  Edward H. Adelson,et al.  SparkleVision: Seeing the world through random specular microfacets , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[6]  Jaime Martín,et al.  Tracking objects outside the line of sight using 2D intensity images , 2016, Scientific Reports.

[7]  R. Fergus,et al.  Random Lens Imaging , 2006 .

[8]  Vivek K. Goyal,et al.  Photon-efficient computational imaging with a single-photon camera , 2016 .

[9]  Adam L. Cohen Anti-pinhole Imaging , 1982 .

[10]  Jake K. Aggarwal,et al.  Human detection using depth information by Kinect , 2011, CVPR 2011 WORKSHOPS.

[11]  Ramesh Raskar,et al.  Estimating Motion and size of moving non-line-of-sight objects in cluttered environments , 2011, CVPR 2011.

[12]  Martin Laurenzis,et al.  Dual-mode optical sensing: three-dimensional imaging and seeing around a corner , 2016 .

[13]  Wolfgang Heidrich,et al.  Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination Using Inexpensive Time-of-Flight Sensors , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[15]  Antonio Torralba,et al.  Accidental pinhole and pinspeck cameras: Revealing the scene outside the picture , 2012, CVPR.

[16]  Gordon Wetzstein,et al.  Computational imaging with multi-camera time-of-flight systems , 2016, ACM Trans. Graph..

[17]  Robert Henderson,et al.  Detection and tracking of moving objects hidden from view , 2015, Nature Photonics.

[18]  Ashley Tews,et al.  Pedestrian detection in industrial environments: Seeing around corners , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[20]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[21]  Shree K. Nayar,et al.  Corneal Imaging System: Environment from Eyes , 2006, International Journal of Computer Vision.