Adaptive Robotic Visual Tracking

Current robotic systems lack the flexibility of dynamic interaction with the environment. The use of sensors can make the robotic systems more flexible. Among the different types of sensors, visual sensors play a critical role. This paper addresses some of the issues associated with the use of a visual sensor in the feedback loop. In particular, algorithms are proposed for the solution of the robotic (hand-eye configuration) visual tracking and servoing problem. We state the problem of robotic visual tracking as a problem of combining control with computer vision. We propose the use of sum-of-squared differences (SSD) optical flow for the computation of the vector of discrete displacements. These displacements are fed to an adaptive controller (self-tuning regulator) that drives implemented three different adaptive control schemes and the results are presented in this paper.

[1]  James Thomas Harris,et al.  Theory and Application of Self-Tuning Regulators , 1977 .

[2]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[3]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[4]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[5]  David Heeger,et al.  Depth and Flow From Motion Energy , 1986, AAAI.

[6]  Allen M. Waxman,et al.  Progress on the prototype PIPE , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[7]  P. Anandan.  Measuring Visual Motion From Image Sequences , 1987 .

[8]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[9]  Ren C. Luo,et al.  An adaptive robotic tracking system using optical flow , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[10]  Peter K. Allen,et al.  Real-time motion tracking using spatio-temporal filters , 1989 .

[11]  Takeo Kanade,et al.  Vision and control techniques for robotic visual tracking , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.