A 26.5 nJ/px 2.64 Mpx/s CMOS vision sensor for Gaussian pyramid extraction

This paper introduces a CMOS vision sensor to extract the Gaussian pyramid with an energy cost of 26.5 nJ/px at 2.64 Mpx/s, thus outperforming conventional solutions employing an imager and a separate digital processor. The chip, manufactured in a 0.18 μm CMOS technology, consists of an arrangement of 88 × 60 processing elements (PEs) which captures images of 176 × 120 resolution and performs concurrent parallel processing right at pixel level. The Gaussian pyramid is generated by using a switched-capacitor network. Every PE includes four photodiodes, four MiM capacitors, one 8-bit single-slope ADC and one CDS circuit, occupying 44 × 44 μm2. Suitability of the chip is assessed by using metrics pertaining to visual tracking.

[1]  Hong Wang,et al.  Image feature extraction for mobile processors , 2009, 2009 IEEE International Symposium on Workload Characterization (IISWC).

[2]  Masahiko Yoshimoto,et al.  Fast and Low-Memory-Bandwidth Architecture of SIFT Descriptor Generation with Scalability on Speed and Accuracy for VGA Video , 2010, 2010 International Conference on Field Programmable Logic and Applications.

[3]  Ángel Rodríguez-Vázquez,et al.  Switched-capacitor networks for scale-space generation , 2011, 2011 20th European Conference on Circuit Theory and Design (ECCTD).

[4]  Ángel Rodríguez-Vázquez,et al.  A CMOS Vision System On-Chip with Multi-Core, Cellular Sensory-Processing Front-End , 2010 .

[5]  Joseph R. Cavallaro,et al.  Workload analysis and efficient OpenCL-based implementation of SIFT algorithm on a smartphone , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[6]  Victor M. Brea,et al.  CMOS-3D Smart Imager Architectures for Feature Detection , 2012, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[7]  R. del Río,et al.  Smart imaging for power-efficient extraction of Viola-Jones local descriptors , 2014, Electronic Imaging.

[8]  Tobias Höllerer,et al.  Evaluation of Interest Point Detectors and Feature Descriptors for Visual Tracking , 2011, International Journal of Computer Vision.

[9]  Yung-Chang Chen,et al.  High-Performance SIFT Hardware Accelerator for Real-Time Image Feature Extraction , 2012, IEEE Transactions on Circuits and Systems for Video Technology.