A new approach of smart vision sensors

Today's digital image sensors are used as passive photon integrators and image processing is essentially performed by digital processors separated from the image sensing part. This approach imposes to the processing part to deal with already grabbed pictures with possible unadjusted exposition parameters. This paper presents a fast self-adaptable preprocessing architecture with fast feedbacks on the sensing level. These feedbacks are controlled by digital processing in order to modify the sensor parameters during exposure time. Exposition and processing parameters are tuned in real life to fit with applications requirement depending on scene parameters. Considering emerging integration technologies such as 3D stacking, this paper presents an innovative way of designing smart vision sensors, integrating feedback control and opening new approaches for machine vision architectures.

[1]  Laurent Letellier,et al.  The eISP low-power and tiny silicon footprint programmable video architecture , 2011, Journal of Real-Time Image Processing.

[2]  Dah-Jye Lee,et al.  Hardware-Friendly Vision Algorithms for Embedded Obstacle Detection Applications , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Annamaria R Varkonyi-Koczy.  Improved fuzzy logic supported HDR colored information enhancement , 2009, 2009 IEEE Instrumentation and Measurement Technology Conference.

[4]  Robert S. Patti,et al.  Three-Dimensional Integrated Circuits and the Future of System-on-Chip Designs , 2006, Proceedings of the IEEE.

[5]  Jian Xu,et al.  Demystifying 3D ICs: the pros and cons of going vertical , 2005, IEEE Design & Test of Computers.

[6]  Lionel Lacassagne,et al.  Adaptive Multiresolution for Low Power CMOS Image Sensor , 2007, 2007 IEEE International Conference on Image Processing.

[7]  Kwang-Ting Cheng,et al.  An error tolerance scheme for 3D CMOS imagers , 2010, Design Automation Conference.

[8]  Jia Su,et al.  Motion detection based motion estimation algorithm for video surveillance application , 2009, 2009 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[9]  Martin Litzenberger,et al.  Embedded Smart Camera for High Speed Vision , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[10]  Shoushun Chen,et al.  A second generation 3D integrated feature-extracting image sensor , 2011, 2011 IEEE SENSORS Proceedings.

[11]  Chih-Cheng Hsieh,et al.  A new CMOS image sensor readout structure for 3D integrated imagers , 2011, 2011 IEEE Custom Integrated Circuits Conference (CICC).

[12]  Laurent Letellier,et al.  Exploration platform of embedded simd architecture for autonomous retinas , 2010, 2010 Conference on Design and Architectures for Signal and Image Processing (DASIP).

[13]  Eric R. Fossum,et al.  CMOS image sensors: electronic camera on a chip , 1995, Proceedings of International Electron Devices Meeting.

[14]  Kazumasa Tanida,et al.  Chip Scale Camera Module (CSCM) using Through-Silicon-Via (TSV) , 2009, 2009 IEEE International Solid-State Circuits Conference - Digest of Technical Papers.

[15]  Dieter Schmalstieg,et al.  Real-Time Detection and Tracking for Augmented Reality on Mobile Phones , 2010, IEEE Transactions on Visualization and Computer Graphics.

[16]  Abbas El Gamal,et al.  Synthesis of high dynamic range motion blur free image from multiple captures , 2003 .

[17]  Abbas El Gamal,et al.  Pixel-level processing: why, what, and how? , 1999, Electronic Imaging.

[18]  Dominique Ginhac,et al.  Design of a 10000 Frames/s CMOS Sensor with In Situ Image Processing , 2006, ReCoSoC.

[19]  Lionel Lacassagne,et al.  Image Processing Vision Systems: Standard Image Sensors Versus Retinas , 2007, IEEE Transactions on Instrumentation and Measurement.

[20]  S. Sugawa,et al.  A 1.9 $e^{-}$ Random Noise CMOS Image Sensor With Active Feedback Operation in Each Pixel , 2009, IEEE Transactions on Electron Devices.

[21]  H. Ohkubo,et al.  A signal-processing CMOS image sensor using a simple analog operation , 2001, 2001 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC (Cat. No.01CH37177).

[22]  Lorenzo Verdoscia,et al.  Image processing chain for digital still cameras based on the SIMPil architecture , 2005, 2005 International Conference on Parallel Processing Workshops (ICPPW'05).

[23]  Bernd Hoefflinger.  Vision Sensors and Cameras , 2011 .

[24]  Weiyao Lin,et al.  A new algorithm for improving Deblurring effects and addressing spatially-variant blur problems for image motion deblurring , 2011, 2011 4th International Congress on Image and Signal Processing.

[25]  Shao-Yi Chien,et al.  CRISP: Coarse-Grained Reconfigurable Image Stream Processor for Digital Still Cameras and Camcorders , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Sunetra K. Mendis,et al.  CMOS active pixel image sensor , 1994 .

[27]  Jan Kautz,et al.  Exposure Fusion , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[28]  Nicolas Ventroux,et al.  Stereovision-based 3D obstacle detection for automotive safety driving assistance , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[29]  A. El Gamal,et al.  CMOS image sensors , 2005, IEEE Circuits and Devices Magazine.