Image processing vision system implementing a smart sensor

There are many vision algorithms of image processing with CMOS image sensors such as image enhancement, segmentation, feature extraction and pattern recognition. These algorithms are frequently used in software-based operations. Here, the main research interest focuses on how to integrate image processing (vision) algorithms with CMOS integrated systems or how to implement smart retinas in hardware, in terms of their system-level architecture and design methodologies. The approach is compared with state-of-the-art vision chips build using digital SIMD arrays and vision systems using CMOS sensors combined with FPGA technology. As a test bench, an advanced algorithm for an exposure time calibration is presented with experimental results of image processing.

[1]  D. Scott Wills,et al.  Real-Time Image Processing on a Focal Plane SIMD Array , 1999, IPPS/SPDP Workshops.

[2]  Richard Hornsey,et al.  Pixel-parallel CMOS active pixel sensor for fast object location , 2004, SPIE Optics + Photonics.

[3]  Piotr Dudek,et al.  A CMOS general-purpose sampled-data analogue microprocessor , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[4]  Abbas El Gamal,et al.  Pixel-level processing: why, what, and how? , 1999, Electronic Imaging.

[5]  Jacques-Olivier Klein,et al.  A DSP‐like analogue processing unit for smart image sensors , 2002, Int. J. Circuit Theory Appl..

[6]  Dariu Gavrila,et al.  Real-time object detection for "smart" vehicles , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  César Torres-Huitzil,et al.  Real-time field programmable gate array architecture for computer vision , 2001, J. Electronic Imaging.

[8]  Y. Ni,et al.  A 256/spl times/256 pixel smart CMOS image sensor for line-based stereo vision applications , 2000, IEEE Journal of Solid-State Circuits.

[9]  Abdelhafid Elouardi,et al.  Evaluation of an artificial CMOS retina sensor for tracking systems , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[10]  Antoine Dupret,et al.  Improved ARAM for PARIS, an original programmable vision chip , 2002, Proceedings of the 2002 7th IEEE International Workshop on Cellular Neural Networks and Their Applications.

[11]  Shoji Muramatsu,et al.  Image processing device for automotive vision systems , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[12]  Antoine Dupret,et al.  A programmable vision chip for CNN based algorithms , 2000, Proceedings of the 2000 6th IEEE International Workshop on Cellular Neural Networks and their Applications (CNNA 2000) (Cat. No.00TH8509).