Asynchronous demodulation CMOS sensor for object labeling and its application in robotics

Purpose – The purpose of this paper is to present a novel image‐labeling CMOS sensor for modulated marker detection.Design/methodology/approach – An image scene with multiple objects, each identified by a flashing light‐emitting diode (LED), is captured by the sensor. The LED's frequency is a representation of the object ID‐tag. The sensor detects and labels the objects by identifying the signal frequencies. The processing is performed in‐pixel and, since the object detection task is simplified, power dissipation is reduced. A 64×64 pixel sensor is designed in the 0.6 μm CMOS technology.Findings – Simulation results show successful object identification. At a frame rate of 250 fps the measured power consumption is 11 mW, which is less than those of the previously reported object detection solutions. The application of the presented sensor is shown in several different robotic fields such as unmanned aerial vehicles (UAVs) vision, household robots and industrial robots. It is also explained how the sensor ...

[1]  S. Ando,et al.  Correlation image sensor: two-dimensional matched detection of amplitude-modulated light , 2003 .

[2]  Peter K. Allen,et al.  Vision for mobile robot localization in urban environments , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Jun Rekimoto,et al.  CyberCode: designing augmented reality environments with visual tags , 2000, DARE '00.

[4]  R. Lange,et al.  Solid-state time-of-flight range camera , 2001 .

[5]  N. Nasios,et al.  Variational learning for Gaussian mixture models , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Ralph Etienne-Cummings,et al.  Single chip for imaging, colour segmentation, histogramming and template matching , 2002 .

[7]  S. Kleinfelder,et al.  A 10 kframe/s 0.18 /spl mu/m CMOS digital pixel sensor with pixel-level memory , 2001, 2001 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC (Cat. No.01CH37177).

[8]  Dorin Comaniciu,et al.  An Algorithm for Data-Driven Bandwidth Selection , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Hassan Hajjdiab,et al.  Vision-based multi-robot simultaneous localization and mapping , 2004, First Canadian Conference on Computer and Robot Vision, 2004. Proceedings..

[10]  Alejandro Ramirez-Serrano,et al.  Mobile robot localization in quasi-dynamic environments , 2008, Ind. Robot.

[11]  Y. Ni,et al.  Smart image sensing in CMOS technology , 2005 .

[12]  Wan Kyun Chung,et al.  A robust localization algorithm in topological maps with dynamic noises , 2008, Ind. Robot.

[13]  Roy Want,et al.  Implementing phicons: combining computer vision with infrared technology for interactive physical icons , 1999, UIST '99.

[14]  Jun Rekimoto,et al.  ID CAM: a smart camera for scene capturing and ID recognition , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[15]  Gunhee Han,et al.  Single-Chip Eye Tracker Using Smart CMOS Image Sensor Pixels , 2003, 2003 46th Midwest Symposium on Circuits and Systems.

[16]  Y. Audet,et al.  A new CMOS multimode digital pixel sensor dedicated to an implantable visual cortical stimulator , 2006 .

[17]  Jan Van der Spiegel,et al.  A CMOS Image Processing Sensor for the Detection of Image Features , 2005 .

[18]  C. Toumazou,et al.  A micropower centroiding vision processor , 2006, IEEE Journal of Solid-State Circuits.

[19]  Mehdi Habibi,et al.  Analysis and optimization of the asynchronous modulated light detection pixel , 2011 .

[20]  Abbas El Gamal,et al.  Analysis of temporal noise in CMOS photodiode active pixel sensor , 2001, IEEE J. Solid State Circuits.

[21]  Sooyong Lee.  Use of infrared landmark zones for mobile robot localization , 2008, Ind. Robot.

[22]  Kunihiro Asada,et al.  An Image Sensor with High-Speed Feeble ID Beacon Detection for Augmented Reality System , 2003 .

[23]  Keiichiro Kagawa,et al.  An image sensor with an in-pixel demodulation function for detecting the intensity of a modulated light signal , 2003 .

[24]  Tzi-Dar Chiueh,et al.  An analog motion field detection chip for image segmentation , 2002, IEEE Trans. Circuits Syst. Video Technol..