A low power multi-mode CMOS image sensor with integrated on-chip motion detection

In this paper, we propose a novel low power multimode CMOS smart image sensor node with integrated focal-plane motion detection and video compression. An 80×80 image pixel array is fabricated in 0.5 μm 3M2P standard CMOS technology, occupying 3×3 mm2 silicon area. The proposed imager enables various operational modes, including 1) event generator mode, 2) motion tracking mode and 3) video output mode in full-resolution or compression by region of interest (ROI). An ultra low power focal-plane motion detection block, consisting of analog memory and dual-threshold comparator, is integrated in the pixel-level circuit for on-chip motion detection. A hardware-friendly motion tracking algorithm is developed that indicates ROIs according to a strategy based on the detection results. A 12-bit on-chip, off-array ADC is employed to convert the captured light intensity into digital readouts. In order to further reduce the power consumption, lower image resolution is used under the first two modes. A trade-off analysis between the image resolution and detection accuracy is proposed in this paper. In simulation, the total power consumption is 10μW at a frame rate of 30fps and a supply voltage of 3.3V in motion tracking mode. A compression ratio of 14% and an average PSNR of 42dB is achieved in compressive video output mode.

[1]  Bo Zhao,et al.  A CMOS image sensor with on-chip motion detection and object localization , 2011, 2011 IEEE Custom Integrated Circuits Conference (CICC).

[2]  H. Jiang,et al.  A 2-D velocity- and direction-selective sensor with BJT-based silicon retina and temporal zero-crossing detector , 1999 .

[3]  Bo Zhao,et al.  A 64$\,\times\,$64 CMOS Image Sensor With On-Chip Moving Object Detection and Localization , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Gert Cauwenberghs,et al.  CMOS Camera With In-Pixel Temporal Change Detection and ADC , 2007, IEEE Journal of Solid-State Circuits.

[5]  S. Mitra,et al.  A low-power dual-threshold comparator for neuromorphic systems , 2005, Research in Microelectronics and Electronics, 2005 PhD.

[6]  Andreas G. Andreou,et al.  Silicon retina for motion computation , 1991, 1991., IEEE International Sympoisum on Circuits and Systems.

[7]  Jan Van der Spiegel,et al.  A focal plane visual motion measurement sensor , 1997 .

[8]  E. Fossum,et al.  CMOS active pixel image sensors for highly integrated imaging systems , 1997, IEEE J. Solid State Circuits.

[9]  Peter Palensky,et al.  Communication and Computation in Buildings: A Short Introduction and Overview , 2010, IEEE Transactions on Industrial Electronics.