Low power high-performance smart camera system based on SCAMP vision sensor

Vision sensors based upon pixel-parallel cellular processor arrays offer the unique opportunity to realise high-performance, flexible, low power image processing systems. By virtue of processing on the focal-plane, the energy-demanding requirement to digitize a captured frame's raw pixel data is reduced, with returned data constituting only that which is salient. We describe a stand-alone vision system incorporating a SCAMP-3 vision chip, an FPGA and an ARM Cortex-M3 microcontroller. SCAMP integrated circuits operate as SIMD computers; each pixel incorporating a compact but powerful analogue processor and local memory, with all operations occurring in parallel over the 128x128 array. Algorithms are developed to operate natively upon the focal-plane as far as possible, with additional serial and higher-level operations occurring on the microcontroller. The power consumption of the system is algorithm-dependent. An algorithm developed for loiterer detection at 8fps has been shown to consume an average power of 5.5mW, with a more complex object tracking and counting system consuming 29mW.

[1]  Michiel Steyaert,et al.  Analog Circuit Design: Sensors, Actuators and Power Drivers; Integrated Power Amplifiers from Wireline to RF; Very High Frequency Front Ends , 2008 .

[2]  Ricardo Carmona-Galán,et al.  FLIP-Q: A QCIF Resolution Focal-Plane Array for Low-Power Image Processing , 2011, IEEE Journal of Solid-State Circuits.

[3]  Teresa H. Y. Meng,et al.  Transpose memory for video rate JPEG compression on highly parallel single-chip digital CMOS imager , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[4]  Mohammad Tariqul Islam,et al.  Smart Antenna UKM Testbed for Digital Beamforming System , 2009, EURASIP J. Adv. Signal Process..

[5]  Ari Paasio,et al.  MIPA4k: A 64×64 cell mixed-mode image processor array , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[6]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[7]  Roberto Manduchi,et al.  An Ultra-Low-Power Contrast-Based Integrated Camera Node and its Application as a People Counter , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[8]  John B. Hughes,et al.  S/sup 2/I: a switched-current technique for high performance , 1993 .

[9]  Piotr Dudek.  A flexible global readout architecture for an analogue SIMD vision chip , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[10]  Piotr Dudek.  An asynchronous cellular logic network for trigger-wave image processing on fine-grain massively parallel arrays , 2006, IEEE Transactions on Circuits and Systems II: Express Briefs.

[11]  Piotr Dudek,et al.  APRON: A Cellular Processor Array Simulation and Hardware Design Tool , 2009, EURASIP J. Adv. Signal Process..

[12]  Nicola Cottini,et al.  A CMOS Ultra-Low Power Vision Sensor With Image Compression and Embedded Event-Driven Energy-Management , 2011, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[13]  Piotr Dudek,et al.  Demonstration of a low power image processing system using a SCAMP3 vision chip , 2011, 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras.

[14]  Piotr Dudek,et al.  A CMOS general-purpose sampled-data analog processing element , 2000 .

[15]  Rita Cucchiara,et al.  Energy-efficient feedback tracking on embedded smart cameras by hardware-level optimization , 2011, 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras.

[16]  Piotr Dudek,et al.  General-purpose 128×128 SIMD processor array with integrated image sensor , 2006 .

[17]  P. Dudek,et al.  Low power multiple object tracking and counting using a SCAMP cellular processor array , 2012, 2012 13th International Workshop on Cellular Nanoscale Networks and their Applications.

[18]  Ángel Rodríguez-Vázquez,et al.  The Eye-RIS CMOS Vision System , 2008 .

[19]  Sufen Fong,et al.  MeshEye: A Hybrid-Resolution Smart Camera Mote for Applications in Distributed Intelligent Surveillance , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[20]  S.J. Carey,et al.  A Control System for a Cellular Processor Array , 2006, 2006 10th International Workshop on Cellular Neural Networks and Their Applications.