Planning and Control of Mobile Robots in Image Space from Overhead Cameras

In this work, we present a framework for the development of a planar mobile robot controller based on image plane feedback. We show that the design of such a motion controller can be accomplished in the image plane by making use of a subset of the parameters that relate the image plane to the ground plane, while still leveraging the simplifications offered by modeling the system as a differentially flat system. Our method relies on a waypoint-based trajectory generator, with all the waypoints specified in the image, as seen by an overhead observer. We present some results from simulation as well as from experiments that validate the ideas presented in this work and discuss some ideas for future work.

[1]  Sunil K. Agrawal,et al.  Trajectory Planning of Differentially Flat Systems with Dynamics and Inequalities , 2000 .

[2]  Vijay Kumar,et al.  Visual servoing of a UGV from a UAV using differential flatness , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[3]  M. Fliess,et al.  Flatness and defect of non-linear systems: introductory theory and examples , 1995 .

[4]  Daniel E. Koditschek,et al.  Preliminary Experiments in Spatial Robot Juggling , 1991, ISER.

[5]  Banavar Sridhar,et al.  Modelling issues in vision based aircraft navigation during landing , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[6]  R. L. Andersson.  Real time expert system to control a robot ping-pong player , 1987 .

[7]  Luiz Chaimowicz,et al.  ROCI: a distributed framework for multi-robot perception and control , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[8]  Yoshiaki Shirai,et al.  Guiding a robot by visual feedback in assembling tasks , 1973, Pattern Recognit..

[9]  Vijay Kumar,et al.  Experiments in Robot Control from Uncalibrated Overhead Imagery , 2004, ISER.

[10]  Richard M. Murray,et al.  Real Time Trajectory Generation for Differentially Flat Systems , 1996 .

[11]  Todd Jochem,et al.  Rapidly Adapting Machine Vision for Automated Vehicle Steering , 1996, IEEE Expert.

[12]  W. Beyer.  CRC Standard Mathematical Tables and Formulae , 1991 .

[13]  Daniel Zwillinger,et al.  CRC standard mathematical tables and formulae; 30th edition , 1995 .

[14]  R. Murray,et al.  Differential Flatness of Mechanical Control Systems: A Catalog of Prototype Systems , 1995 .

[15]  C. Altafini,et al.  Autonomous landing by computer vision: an application of path following in SE(3) , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[16]  Chi-Tsong Chen,et al.  Linear System Theory and Design , 1995 .

[17]  R. C. Harrell,et al.  A fruit-tracking system for robotic harvesting , 2005, Machine Vision and Applications.

[18]  Vijay Kumar,et al.  Calibrating an air-ground control system from motion correspondences , 2004, CVPR 2004.