Active vision for reliable ranging: Cooperating focus, stereo, and vergence

This article addresses the problem of measuring reliabily the absolute three-dimensional position of objects in an unknown and cluttered scene. It circumvents the limitations of a single sensor or single algorithm by using several range recovery techniques together, so that they cooperate in visual behaviors similar to those exhibited by the human visual system. Implemented visual behaviors include (i) aperture adjustment to vary depth of field and contrast, (ii) focus ranging followed by fixation, (iii) stereo ranging followed by focus ranging, and (iv) focus ranging followed by disparity prediction followed by focus ranging. The main contribution is a demonstration that two particular visual ranging processes—focusing and stereo—can cooperate to improve measurement reliability. The results of 75 experiments processing close to 3000 different object points lying at distances between 1 and 3 meters demonstrate that the computed range values are highly reliable.

[1]  Victor R. Lesser,et al.  The Distributed Vehicle Monitoring Testbed: A Tool for Investigating Distributed Problem Solving Networks , 1983, AI Mag..

[2]  James J. Clark,et al.  Modal Control Of An Attentive Vision System , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[3]  P R KENT,et al.  Convergence accommodation. , 1958, American journal of optometry and archives of American Academy of Optometry.

[4]  Thomas J. Olson,et al.  Real-time vergence control for binocular robots , 1991, International Journal of Computer Vision.

[5]  Thomas J. Olson,et al.  Real time vergence control , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  A. Lynn Abbott,et al.  Surface Reconstruction By Dynamic Integration Of Focus, Camera Vergence, And Stereo , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[7]  Maher A. Sid-Ahmed,et al.  3-D Position Sensing Using a Passive Monocular Vision System , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  V. V. Krishnan,et al.  A Heuristic Model for the Human Vergence Eye Movement System , 1977, IEEE Transactions on Biomedical Engineering.

[9]  Y. Aloimonos,et al.  Visual shape computation , 1988, Proc. IEEE.

[10]  P. Grossmann,et al.  Depth from focus , 1987, Pattern Recognit. Lett..

[11]  Dana H. Ballard,et al.  Reference Frames for Animate Vision , 1989, IJCAI.

[12]  Daniel D. Corkill,et al.  THE DISTRIBUTED VEHICLE MONITORING TESTBED , 1983 .

[13]  W. H. Ittelson.  Visual space perception , 1961 .

[14]  Shree K. Nayar,et al.  Shape from focus: an effective approach for rough surfaces , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[15]  Eric Paul Krotkov,et al.  Active Computer Vision by Cooperative Focus and Stereo , 1989, Springer Series in Perception Engineering.

[16]  Dana H. Ballard,et al.  Eye Fixation And Early Vision: Kinetic Depth , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[17]  Randall Davis,et al.  Frameworks for Cooperation in Distributed Problem Solving , 1988, IEEE Transactions on Systems, Man, and Cybernetics.

[18]  Peter Lawrence,et al.  An Investigation of Methods for Determining Depth from Focus , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Jay Martin Tenenbaum,et al.  Accommodation in computer vision , 1971 .

[20]  Narendra Ahuja,et al.  Multiresolution image acquisition and surface reconstruction , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[21]  W C GOGEL,et al.  Convergence as a cue to absolute distance. , 1961, Report. Army Medical Research Laboratory.

[22]  Christopher M. Brown,et al.  Intelligent gaze control in binocular vision , 1990, Proceedings. 5th IEEE International Symposium on Intelligent Control 1990.

[23]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Eric Krotkov,et al.  An agile stereo camera system for flexible image acquisition , 1988, IEEE J. Robotics Autom..

[25]  G. Sperling.  Binocular Vision: A Physical and a Neural Theory , 1970 .

[26]  Eric L. W. Grimson,et al.  From Images to Surfaces: A Computational Study of the Human Early Visual System , 1981 .

[27]  Michael Werman,et al.  Active vision: 3D from an image sequence , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[28]  Randall Davis,et al.  Negotiation as a Metaphor for Distributed Problem Solving , 1988, Artificial Intelligence.

[29]  Ralf Kories,et al.  Stereo Ranging with Verging Cameras , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  R. Bajcsy.  Active perception , 1988 .

[31]  Alan H. Bond,et al.  Readings in Distributed Artificial Intelligence , 1988 .

[32]  Edmund H. Durfee,et al.  Trends in Cooperative Distributed Problem Solving , 1989, IEEE Trans. Knowl. Data Eng..

[33]  F A Miles,et al.  Optically induced changes in the couplings between vergence and accommodation , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  Chengqi Zhang.  Cooperation Under Uncertainty in Distributed Expert Systems , 1992, Artif. Intell..

[35]  Davi Geiger,et al.  STEREOPSIS AND EYE-MOVEMENT. , 1987 .

[36]  Clifton M. Schor,et al.  The relationship between fusional vergence eye movements and fixation disparity , 1979, Vision Research.

[37]  Murali Subbarao.  Parallel Depth Recovery By Changing Camera Parameters , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[38]  Victor R. Lesser,et al.  Functionally Accurate, Cooperative Distributed Systems , 1988, IEEE Transactions on Systems, Man, and Cybernetics.

[39]  E F FINCHAM,et al.  The reciprocal actions of accommodation and convergence , 1957, The Journal of physiology.

[40]  R. Kories,et al.  Adaptive control of cooperating sensors: focus and stereo ranging with an agile camera system , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[41]  Frank P. Ferrie,et al.  From Uncertainty to Visual Exploration , 1991, IEEE Trans. Pattern Anal. Mach. Intell..