论文信息 - Neuromorphic implementation of active gaze and vergence control

Neuromorphic implementation of active gaze and vergence control

We present an active stereo system with gaze and vergence control driven by model of the disparity selective neurons in the mammalian visual cortex. The hardware consists of a mobile stereo camera and three Multimap boards. The Multi- map boards compute multiple cortical maps responding to target locations, orientations and disparities, and generate movement commands to track target in space. Each board can compute more than 10 cortical maps at 320*240 pixel resolution and 25 frames per second, and consumes 3.5 W.

Bertram E. Shi | Stanley Y. M. Lam | Eric K. C. Tsang | Yicong Meng

[1] Bertram E. Shi,et al. Expandable hardware for computing cortical feature maps , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[2] David J. Fleet,et al. Neural encoding of binocular disparity: Energy models, position shifts and phase shifts , 1996, Vision Research.

[3] I. Ohzawa,et al. Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.

[4] Ning Qian,et al. Computing Stereo Disparity and Motion with Known Binocular Cell Properties , 1994, Neural Computation.

[5] Bertram E. Shi,et al. Estimating disparity with confidence from energy neurons , 2007, NIPS.

[6] S. Thorpe,et al. Rapid categorization of natural images by rhesus monkeys , 1998, Neuroreport.

[7] Hanspeter A. Mallot,et al. Vergence Control and Disparity Estimation with Energy Neurons: Theory and Implementation , 2002, ICANN.