Visual servoing using dynamic image parameters

Visual servoing is a framework for achieving the tight coupling of camera movements and information from images. We consider a typical visual servoing approach that uses geometric information about image features for controlling the position and attitude of a camera. We extend the applicability of this approach by using image motion information. To this end, we present two different approaches to visual tasks that use motion information. The first one uses the focus of expansion. The second one incorporates the parameters of the 2D affine motion model in control equations. We illustrate both these approaches by means of a task to align the optical axis of the camera with the unknown direction of translational motion of the system on which it is mounted. We present results of simulation experiments, and real experiments done with a six DOF robot with a camera on its end-effector. The contributions of this work are in particular extending the visual servoing formalism beyond using just image features, and in general showing that a tight coupling between camera behavior and image motion is possible.

[1]  Andrea J. van Doorn,et al.  Invariant Properties of the Motion Parallax Field due to the Movement of Rigid Bodies Relative to an Observer , 1975 .

[2]  David N. Lee,et al.  Visual control of locomotion. , 1977, Scandinavian journal of psychology.

[3]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[4]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[5]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[6]  Claude Samson,et al.  Robot Control: The Task Function Approach , 1991 .

[7]  Giulio Sandini,et al.  Active/Dynamic Stereo for Navigation , 1992, ECCV.

[8]  Dana H. Ballard,et al.  Principles of animate vision , 1992, CVGIP Image Underst..

[9]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[10]  Yiannis Aloimonos,et al.  Active Egomotion Estimation: A Qualitative Approach , 1992, ECCV.

[11]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[12]  Ruzena Bajcsy,et al.  Active and exploratory perception , 1992, CVGIP Image Underst..

[13]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[14]  Matthew J. Barth,et al.  Egomotion determination through an intelligent gaze control strategy , 1993, IEEE Trans. Syst. Man Cybern..

[15]  Peter K. Allen,et al.  Automated tracking and grasping of a moving object with a robotic hand-eye system , 1993, IEEE Trans. Robotics Autom..

[16]  Karen Roberts,et al.  Centering behavior using peripheral vision , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[17]  François Chaumette,et al.  Tracking a Moving Object by Visual Servoing , 1993 .

[18]  Giulio Sandini,et al.  Divergent stereo for robot navigation: learning from bees , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Ian D. Reid,et al.  Reactions to peripheral image motion using a head/eye platform , 1993, 1993 (4th) International Conference on Computer Vision.

[20]  Enrico Grosso,et al.  Head-centered orientation strategies in animate vision , 1993, 1993 (4th) International Conference on Computer Vision.

[21]  Samia Boukir,et al.  Optimal estimation of 3D structures using visual servoing , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Patrick Bouthemy,et al.  Visual servoing using image motion information , 1994 .

[23]  Jean-Marc Odobez,et al.  Robust Multiresolution Estimation of Parametric Motion Models , 1995, J. Vis. Commun. Image Represent..

[24]  Eric Krotkov,et al.  Focusing , 2004, International Journal of Computer Vision.