Disparity Estimation on Log-Polar Images and Vergence Control

An important issue in the realization of an autonomous robot with stereoscopic vision is the control of vergence. Together with version, it determines uniquely the position of the fixation point in space. Vergence control is directly related to both depth perception and binocular fusion. Previous works in this field employed either a measure of correlation of stereo images or some kind of disparity-related estimate. In this paper, we present a new method of extracting a global disparity measure for vergence control, which does not require a priori segmentation of the object of interest. Our method uses images acquired by retina-like sensors and, therefore, the computation is performed in the log-polar plane. The technique we present here is: (i) global, in the sense that it is an integral measure over the whole image, (ii) computationally inexpensive, considering that the goal was to use it in the robot control loop rather than to accurately measure some 3D world features. Moreover, the proposed technique is robust and independent of the average illumination as well as of other features of the target such as size, shape, and direction of motion. It provides a precise and linear estimate of the vergence error, which is the only requirement from the control point of view. Several experimental results on a real robotic setup demonstrate the effectiveness of the proposed technique.

[1]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  D. Vleeschauwer An intensity-based, coarse-to-fine approach to reliably measure binocular disparity , 1993 .

[3]  Giulio Sandini,et al.  Visuo-inertial stabilization in space-variant binocular systems , 2000, Robotics Auton. Syst..

[4]  Giulio Sandini,et al.  A space-variant approach to oculomotor control , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[5]  Svetha Venkatesh,et al.  From Living Eyes to Seeing Machines , 1997 .

[6]  Giulio Sandini,et al.  A Binocular Active Vision System Using Space Variant Sensors: Exploiting Autonomous Behaviors for Sp , 1993 .

[7]  Jan-Olof Eklundh,et al.  Integrating primary ocular processes , 1992, Image Vis. Comput..

[8]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[9]  Giulio Sandini,et al.  Project SVAVISCA: a space-variant color CMOS sensor , 1998, Other Conferences.

[10]  D. Whitteridge,et al.  The representation of the visual field on the cerebral cortex in monkeys , 1961, The Journal of physiology.

[11]  Antonio Bicchi,et al.  Closed-loop steering for unicycle-like vehicles: A simple lyapunov like approach , 1994 .

[12]  Christopher C. Yang,et al.  Gaze stabilization in active vision--I. Vergence error extraction , 1997, Pattern Recognit..

[13]  W. Chambers San Antonio, Texas , 1940 .

[14]  Giulio Sandini,et al.  Robust visual servoing in 3-D reaching tasks , 1996, IEEE Trans. Robotics Autom..

[15]  Alexandre Bernardino,et al.  Vergence control for robotic heads using log-polar images , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[16]  A. Bernardino,et al.  Binocular Visual Tracking : Integration of Perception and Control , 1999 .

[17]  John K. Tsotsos,et al.  Techniques for disparity measurement , 1991, CVGIP Image Underst..

[18]  Giulio Sandini,et al.  Learning mobile robot navigation: a behavior-based approach , 1994, Proceedings of IEEE International Conference on Systems, Man and Cybernetics.

[19]  Worthy N. Martin,et al.  Accurate vergence control in complex scenes , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Antonio Bicchi,et al.  Closed loop steering of unicycle like vehicles via Lyapunov techniques , 1995, IEEE Robotics Autom. Mag..

[21]  Alexandre Bernardino,et al.  Binocular tracking: integrating perception and control , 1999, IEEE Trans. Robotics Autom..

[22]  Alan C. Bovik,et al.  Stereo disparity from multiscale processing of local image phase , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[23]  Fumio Miyazaki,et al.  Binocular tracking using log polar mapping , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[24]  Christopher C. Yang,et al.  Gaze stabilization in active vision--II. Multi-rate vergence control , 1997, Pattern Recognit..

[25]  Ian Horswill,et al.  A $1000 Active Stereo Vision System , 1994 .

[26]  Ian P. Howard,et al.  Binocular Vision and Stereopsis , 1996 .

[27]  F A Miles,et al.  Ocular Compensation for Self‐Motion. Visual Mechanisms , 1992, Annals of the New York Academy of Sciences.

[28]  Giulio Sandini,et al.  Primary Ocular Movements Revisited , 1994 .

[29]  F A Miles,et al.  Ocular responses to translation and their dependence on viewing distance. II. Motion of the scene. , 1991, Journal of neurophysiology.

[30]  Dana H. Ballard,et al.  Principles of animate vision , 1992, CVGIP Image Underst..