Single-Photon Tracking for High-Speed Vision †

Quanta Imager Sensors provide photon detections at high frame rates, with negligible read-out noise, making them ideal for high-speed optical tracking. At the basic level of bit-planes or binary maps of photon detections, objects may present limited detail. However, through motion estimation and spatial reassignment of photon detections, the objects can be reconstructed with minimal motion artefacts. We here present the first demonstration of high-speed two-dimensional (2D) tracking and reconstruction of rigid, planar objects with a Quanta Image Sensor, including a demonstration of depth-resolved tracking.

[1]  Richard K. Miller.  Fundamentals of Machine Vision , 1989 .

[2]  Stanley H. Chan,et al.  Images from Bits: Non-Iterative Image Reconstruction for Quanta Image Sensors , 2016, Sensors.

[3]  Ping Wah Wong,et al.  A 4.1Mpix 280fps stacked CMOS image sensor with array-parallel ADC architecture for region control , 2017, 2017 Symposium on VLSI Circuits.

[4]  Robert Henderson,et al.  Object Tracking and Reconstruction with a Quanta Image Sensor , 2017 .

[5]  Andrew Blake,et al.  Motion Deblurring and Super-resolution from an Image Sequence , 1996, ECCV.

[6]  Stanley H. Chan,et al.  Optimal Threshold Design for Quanta Image Sensor , 2017, IEEE Transactions on Computational Imaging.

[7]  Dakota A. Starkey,et al.  Room temperature 1040fps, 1 megapixel photon-counting image sensor with 1.1um pixel pitch , 2017, Commercial + Scientific Sensing and Imaging.

[8]  E. Fossum,et al.  Room Temperature 1040 fps , 1 Megapixel Photon-Counting Image Sensor with 1 . 1 um Pixel Pitch , 2017 .

[9]  Marco Branciforte,et al.  Optical Image Stabilization ( OIS ) , 2015 .

[10]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[11]  Shree K. Nayar,et al.  Motion-based motion deblurring , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[13]  Robert Henderson,et al.  Bit-plane Processing Techniques for Low-Light, High Speed Imaging with a SPAD-based QIS , 2015 .

[14]  Brian Aull,et al.  Geiger-Mode Avalanche Photodiode Arrays Integrated to All-Digital CMOS Circuits , 2016, Sensors.

[15]  A. Agresti,et al.  Approximate is Better than “Exact” for Interval Estimation of Binomial Proportions , 1998 .

[16]  Masatoshi Ishikawa,et al.  A 1 ms High-Speed Vision Chip with 3 D-Stacked 140 GOPS Column-Parallel PEs for Diverse Sensing Applications , 2017 .

[17]  Pietro Perona,et al.  Vision without the Image , 2016, Sensors.

[18]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Rory R. Duncan,et al.  Smart-aggregation imaging for single molecule localisation with SPAD cameras , 2016, Scientific Reports.

[20]  Andrew J. Holmes,et al.  320×240 oversampled digital single photon counting image sensor , 2014, 2014 Symposium on VLSI Circuits Digest of Technical Papers.

[21]  E. Fossum.  Modeling the Performance of Single-Bit and Multi-Bit Quanta Image Sensors , 2013, IEEE Journal of the Electron Devices Society.

[22]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[23]  Eric R. Fossum,et al.  The Quanta Image Sensor: Every Photon Counts , 2016, Sensors.

[24]  E. Fossum,et al.  A 1 Mjot 1040 fps 0 . 22 e-rms Stacked BSI Quanta Image Sensor with Cluster-Parallel Readout , 2017 .

[25]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.