A novel CMOS image sensor for high speed parallel integral image computation

A novel CMOS image sensor architecture for computing integral image is presented. The proposed circuit reads the image and produces the integral image simultaneously. In the circuit, the image is divided into vertical blocks and integral images of the blocks are computed in parallel. The final integral image is produced using an updating method. To evaluate the performance of the circuit the blob detector implemented in Speeded Up Robust Features (SURF) algorithm is used. In comparison with conventional sequential method, while the final results are similar, the proposed approach is 500 times faster in capturing the integral image of a 160×160 sample image.

[1]  Jan Van der Spiegel,et al.  Current Mode Image Sensor With Two Transistors per Pixel , 2010, IEEE Transactions on Circuits and Systems I: Regular Papers.

[2]  Ichiro Masaki,et al.  Efficient integral image computation on the GPU , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[3]  Christopher H. Messom,et al.  Stream Processing of Integral Images for Real-Time Object Detection , 2008, 2008 Ninth International Conference on Parallel and Distributed Computing, Applications and Technologies.

[4]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[5]  John B. Hughes,et al.  S/sup 3/I: The seamless S/sup 2/I switched-current cell , 1997, Proceedings of 1997 IEEE International Symposium on Circuits and Systems. Circuits and Systems in the Information Age ISCAS '97.

[6]  Steve Furber,et al.  High-performance computing for systems of spiking neurons , 2006 .

[7]  Nan Zhang,et al.  Working towards efficient parallel computing of integral images on multi-core processors , 2010, 2010 2nd International Conference on Computer Engineering and Technology.

[8]  Chung-Ta King,et al.  Parallel Integral Image Generation Algorithm on Multi-core System , 2011, 2011 IEEE Ninth International Symposium on Parallel and Distributed Processing with Applications.

[9]  De la Cruz,et al.  FIELD-PROGRAMMABLE GATE ARRAY IMPLEMENTATION OF A SCALABLE INTEGRAL IMAGE ARCHITECTURE BASED ON SYSTOLIC ARRAYS , 2011 .

[10]  Wulfram Gerstner,et al.  Firing patterns in the adaptive exponential integrate-and-fire model , 2008, Biological Cybernetics.

[11]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[12]  Yingming Hao,et al.  Integral Image Based Fast Algorithm for Two-Dimensional Otsu Thresholding , 2008, 2008 Congress on Image and Signal Processing.

[13]  M. Dobrovolny,et al.  Eye tracking system on embedded platform , 2012, 2012 International Conference on Applied Electronics.

[14]  Tan Yanl.  Fast Two-dimensional Otsu's Thresholding Method Based on Integral Image , 2014 .

[15]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[16]  Thomas M. Breuel,et al.  Efficient implementation of local adaptive thresholding techniques using integral images , 2008, Electronic Imaging.

[17]  W. Gerstner,et al.  Dynamic I-V curves are reliable predictors of naturalistic pyramidal-neuron voltage traces. , 2008, Journal of neurophysiology.

[18]  Guy E. Blelloch,et al.  Prefix sums and their applications , 1990 .

[19]  Fei Long,et al.  A Novel Eye Localization Method Based on Log-Gabor Transform and Integral Image , 2012 .

[20]  Klaus D. McDonald-Maier,et al.  Novel Hardware Algorithms for Row-Parallel Integral Image Calculation , 2009, 2009 Digital Image Computing: Techniques and Applications.

[21]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[22]  Timothy B. Terriberry,et al.  GPU Accelerating Speeded-Up Robust Features , 2008 .

[23]  Derek Bradley,et al.  Adaptive Thresholding using the Integral Image , 2007, J. Graph. Tools.

[24]  Jan Van der Spiegel,et al.  Image sensor with general spatial processing in a 3D integrated circuit technology , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[25]  Jan Van der Spiegel,et al.  Linear Current-Mode Active Pixel Sensor , 2007, IEEE Journal of Solid-State Circuits.

[26]  Franklin C. Crow,et al.  Summed-area tables for texture mapping , 1984, SIGGRAPH.

[27]  Wulfram Gerstner,et al.  Adaptive exponential integrate-and-fire model , 2009, Scholarpedia.

[28]  Wei Huang,et al.  GPU-Based Computation of the Integral Image , 2011, 2011 International Conference on Virtual Reality and Visualization.

[29]  Olga Veksler,et al.  Fast variable window for stereo correspondence using integral images , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[30]  Mark Zwolinski,et al.  A modified Izhikevich model for circuit implementation of spiking neural networks , 2010, 2010 First IEEE Latin American Symposium on Circuits and Systems (LASCAS).

[31]  Arash Ahmadi,et al.  Biologically Inspired Spiking Neurons: Piecewise Linear Models and Digital Implementation , 2012, IEEE Transactions on Circuits and Systems I: Regular Papers.