Trainable attention model based vergence control for active stereo vision system

We propose a new human-like vergence control method for an active stereo vision system. The proposed system uses a trainable selective attention model to localize an interesting object area in each camera. The selected object area in the master camera is compared with that in the slave camera to identify whether the two cameras find the same landmark. If the left and right cameras successfully find the same landmark, the implemented active vision system, with two cameras, focuses on the landmark. Using the motor encoder information, we can detect the depth information automatically. Computer simulation and experimental results show that the proposed vergence control method is very effective in implementing the human-like active stereo vision system.

[1]  KochChristof,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 1998 .

[2]  D. Mitchell Wilkes,et al.  An active vision system for mobile robots , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[3]  Minho Lee,et al.  Saliency map model with adaptive masking based on independent component analysis , 2002, Neurocomputing.

[4]  R Held,et al.  The development of eye alignment, convergence, and sensory binocularity in young infants. , 1994, Investigative ophthalmology & visual science.

[5]  Torsten Kuhlen,et al.  Comparative analysis of fuzzy ART and ART-2A network clustering performance , 1998, IEEE Trans. Neural Networks.

[6]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[7]  A. Lynn Abbott,et al.  Surface Reconstruction By Dynamic Integration Of Focus, Camera Vergence, And Stereo , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[8]  E. P. Krotkov,et al.  Exploratory visual sensing for determining spatial layout with an agile stereo camera system , 1987 .

[9]  Junji Yamato A layered control system for stereo vision head with vergence , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[10]  Paul F. M. J. Verschure,et al.  Saliency Maps Operating on Stereo Images Detect Landmarks and Their Distance , 2002, ICANN.

[11]  J. Moran,et al.  Sensation and perception , 1980 .