Implementation of Visual Tracking System using Artificial Retina Chip and Shape Memory Alloy Actuator

We implemented a visual tracking system using an artificial retina chip and the shape memory alloy actuator. A foveated complementary metal oxide silicon (COMS) retina chip for edge detection was designed and fabricated for an image sensor of the developed system, and the shape memory alloy actuator was used for mimicking the roles of the ocular muscles to track a moving object. Also, we proposed a new computational model that mimics the functional roles of our brain organs for generating the smooth pursuit eye movement. In our model, a neuromorphic model for the medial temporal (MT) cell generates motion energy, and the medial superior temporal (MST) cell is considered to generate an actuating signal so that the developed active vision system smoothly pursues the moving object with similar dynamics to the motion of our eyeball during the smooth pursuit. Experimental results show that the developed system successfully operates to follow the edge information of a moving object.

[1]  Takeo Kanade,et al.  Integrated sensor and range-finding analog signal processor , 1991 .

[2]  A. Guyton,et al.  Textbook of Medical Physiology , 1961 .

[3]  T. Delbruck Silicon retina with correlation-based, velocity-tuned pixels , 1993 .

[4]  John L. Wyatt,et al.  CMOS resistive fuses for image smoothing and segmentation , 1992 .

[5]  Martin D. Levine,et al.  A Review of Biologically Motivated Space-Variant Data Reduction Models for Robotic Vision , 1998, Comput. Vis. Image Underst..

[6]  F. A. Miles,et al.  Target Selection for Pursuit and Saccadic Eye Movements in Humans , 1999, Journal of Cognitive Neuroscience.

[7]  S. Felici,et al.  Response properties of a foveated space-variant CMOS image sensor , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[8]  B. Dierickx,et al.  CMOS foveated image sensor: signal scaling and small geometry effects , 1997 .

[9]  J. L. White,et al.  An active resistor network for Gaussian filtering of images , 1991 .

[10]  Andreas G. Andreou,et al.  Silicon retina for motion computation , 1991, 1991., IEEE International Sympoisum on Circuits and Systems.

[11]  Chung-Yu Wu,et al.  An improved BJT-based silicon retina with tunable image smoothing capability , 1999, IEEE Trans. Very Large Scale Integr. Syst..

[12]  Misha Mahowald,et al.  A silicon model of early visual processing , 1993, Neural Networks.

[13]  Willis J. Tompkins,et al.  Interfacing Sensors to the IBM-PC , 1987 .

[14]  H. Ikeda,et al.  A novel retina chip with simple wiring for edge extraction , 1998, IEEE Photonics Technology Letters.

[15]  Dario L. Ringach,et al.  A ‘tachometer’ feedback model of smooth pursuit eye movements , 1995, Biological Cybernetics.

[16]  Chung-Yu Wu,et al.  A new structure of the 2-D silicon retina , 1995 .

[17]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[18]  Hiroyuki Nakahira,et al.  An image signal multiprocessor on a single chip , 1990 .

[19]  R. Born,et al.  Segregation of Object and Background Motion in Visual Area MT Effects of Microstimulation on Eye Movements , 2000, Neuron.

[20]  Antonio Torralba,et al.  An efficient neuromorphic analog network for motion estimation , 1999 .

[21]  Peter Thier,et al.  The role of cortical area MST in a model of combined smooth eye-head pursuit , 1999, Biological Cybernetics.

[22]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[23]  Christopher C. Pack,et al.  A Neural Model of Smooth Pursuit Control and Motion Perception by Cortical Area MST , 2001, Journal of Cognitive Neuroscience.