Fast tracking of hidden objects with single-pixel detectors

A fast tracking system is demonstrated that is based on single laser illumination and a few single-pixel single photon avalanche diode (SPAD) detectors that improves on the previous tracking of non-line-of-sight motion by a factor of 300 in laser power. With an average illumination power of only 2 mW, a 15 cm ×15 cm object located up to 2.5 m away is tracked whilst outside of the direct line-of-sight and moving at approximately 6 cm/s.

[1]  Robert Henderson,et al.  Detection and tracking of moving objects hidden from view , 2015, Nature Photonics.

[2]  Gabriel Peyré,et al.  Optimal Transport with Proximal Splitting , 2013, SIAM J. Imaging Sci..

[3]  A. Tosi,et al.  Principles and features of Single Photon Avalanche Diode Arrays , 2007 .

[4]  Tyler S. Ralston,et al.  Real-time through-wall imaging using an ultrawideband multiple-input multiple-output (MIMO) phased array radar system , 2010, 2010 IEEE International Symposium on Phased Array Systems and Technology.

[5]  Ramesh Raskar,et al.  Reconstruction of hidden 3D shapes using diffuse reflections , 2012, Optics express.

[6]  M. V. D. Panne,et al.  Displacement Interpolation Using Lagrangian Mass Transport , 2011 .

[7]  Larry S. Davis,et al.  View-based detection and analysis of periodic motion , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[8]  Ramesh Raskar,et al.  Occluded Imaging with Time-of-Flight Sensors , 2016, ACM Trans. Graph..

[9]  Jaime Martín,et al.  Tracking objects outside the line of sight using 2D intensity images , 2016, Scientific Reports.

[10]  Gordon Wetzstein,et al.  Computational imaging with multi-camera time-of-flight systems , 2016, ACM Trans. Graph..

[11]  Ramesh Raskar,et al.  Estimating Motion and size of moving non-line-of-sight objects in cluttered environments , 2011, CVPR 2011.

[12]  Ulla Wandinger,et al.  Introduction to Lidar , 2005 .

[13]  B. Vojnovic.  Advanced Time‐Correlated Single Photon Counting Techniques , 2006 .

[14]  Edoardo Charbon,et al.  A 32×32 50ps resolution 10 bit time to digital converter array in 130nm CMOS for time correlated imaging , 2009, 2009 IEEE Custom Integrated Circuits Conference.

[15]  Ramesh Raskar,et al.  Looking around the corner using transient imaging , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[16]  E. Charbon,et al.  SPAD-based Sensors , 2013 .

[17]  J. Streicher,et al.  Lidar: Range-Resolved Optical Remote Sensing of the Atmosphere , 2005 .

[18]  R. Henderson,et al.  Edinburgh Research Explorer A Low Dark Count Single Photon Avalanche Diode Structure Compatible with Standard Nanometer Scale CMOS Technology , 2009 .

[19]  P. Lions,et al.  Splitting Algorithms for the Sum of Two Nonlinear Operators , 1979 .

[20]  K. Eliceiri,et al.  Non-line-of-sight imaging using a time-gated single photon avalanche diode. , 2015, Optics express.

[21]  R. Raskar,et al.  Single-photon sensitive light-in-fight imaging , 2015, Nature Communications.

[22]  P.-A. Besse,et al.  Design and characterization of a CMOS 3-D image sensor based on single photon avalanche diodes , 2005, IEEE Journal of Solid-State Circuits.

[23]  Heinz H. Bauschke,et al.  Fixed-Point Algorithms for Inverse Problems in Science and Engineering , 2011, Springer Optimization and Its Applications.

[24]  Martin Laurenzis,et al.  Multiple-return single-photon counting of light in flight and sensing of non-line-of-sight objects at shortwave infrared wavelengths. , 2015, Optics letters.

[25]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  R. Raskar,et al.  Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging , 2012, Nature Communications.

[27]  Wolfgang Heidrich,et al.  Low-budget transient imaging using photonic mixer devices , 2013, ACM Trans. Graph..

[28]  M. Cecchini,et al.  Ultrastructural Characterization of the Lower Motor System in a Mouse Model of Krabbe Disease , 2016, Scientific Reports.