A Relative Imaging CMOS Image Sensor for High Dynamic Range and High Frame-Rate Machine Vision Imaging Applications

This paper proposes an unconventional image acquisition scheme for machine vision applications, based on detecting ratios of illumination (pixel) intensities. Detecting relative ratios enables capturing the scene features and patterns almost independently from the local scene illumination resulting in potentially extremely high dynamic range. Moreover, detecting signal ratios using a fully differential circuit optimally suits the intrinsic nature of very large scale integrated design. A scalable and compact hardware implementation is proposed as a proof-of-concept toward relative image acquisition. The proposed photo-current-ratio-detecting pixels completely bypass the need of conventional photo-current integration which enables high frame-rate operation of up to 24000 frames/s. The pulse-width modulated output of the proposed pixel is captured by compact column-parallel readout circuits based on digital counters. The developed 32 × 32 pixel array prototype CMOS image sensor consumes 4 mW of power operating at a nominal 9765 frames/s frame rate, and 6.8 mW of power operating at a maximum 24000 frames/s. The presented prototype design is fully scalable toward newer CMOS fabrication nodes and higher sensor resolution.

[1]  B. Markham,et al.  Summary of Current Radiometric Calibration Coefficients for Landsat MSS, TM, ETM+, and EO-1 ALI Sensors , 2009 .

[2]  F. Heitger,et al.  A 100×100 pixel silicon retina for gradient extraction with steering filter capabilities and temporal output coding , 2002, IEEE J. Solid State Circuits.

[3]  Hongbo Zhu,et al.  A Real-Time Motion-Feature-Extraction VLSI Employing Digital-Pixel-Sensor-Based Parallel Architecture , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Frédo Durand,et al.  Noise-optimal capture for high dynamic range photography , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  M. Gottardi,et al.  A 100 $\mu$ W 128 $\times$ 64 Pixels Contrast-Based Asynchronous Binary Vision Sensor for Sensor Networks Applications , 2009, IEEE Journal of Solid-State Circuits.

[6]  Eugenio Culurciello,et al.  A compact-pixel tri-mode vision sensor , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[7]  Bernabé Linares-Barranco,et al.  A Spatial Contrast Retina With On-Chip Calibration for Neuromorphic Spike-Based AER Vision Systems , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[8]  Ramesh Raskar,et al.  Why I Want a Gradient Camera , 2022 .

[9]  Pierre-Yves Burgi,et al.  A 128 /spl times/ 128 pixel 120 dB dynamic range vision sensor chip for image contrast and orientation extraction , 2003, 2003 IEEE International Solid-State Circuits Conference, 2003. Digest of Technical Papers. ISSCC..

[10]  H. Ohkubo,et al.  A signal-processing CMOS image sensor using a simple analog operation , 2001, 2001 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC (Cat. No.01CH37177).

[11]  Tadashi Shibata,et al.  A Pixel-Parallel Self-Similitude Processing for Multiple-Resolution Edge-Filtering Analog Image Sensors , 2009, IEEE Transactions on Circuits and Systems I: Regular Papers.

[12]  B.J. Hosticka,et al.  A high dynamic range CMOS image sensor for automotive applications , 2000, Proceedings of the 25th European Solid-State Circuits Conference.

[13]  Massimo Barbaro,et al.  A 100/spl times/100 pixel silicon retina for gradient extraction with steering filter capabilities and temporal output coding , 2002 .

[14]  M. Vrakking,et al.  High dynamic range bio-molecular ion microscopy with the Timepix detector. , 2011, Analytical chemistry.

[15]  E. Seevinck,et al.  CMOS translinear circuits for minimum supply voltage , 2000 .