Vision guided navigation for a nonholonomic mobile robot

Theoretical and analytical aspects of the visual servoing problem have not received much attention. Furthermore, the problem of estimation from the vision measurements has been considered separately from the design of the control strategies. Instead of addressing the pose estimation and control problems separately, we attempt to characterize the types of control tasks which can be achieved using only quantities directly measurable in the image, bypassing the pose estimation phase. We consider the task of navigation for a nonholonomic ground mobile base tracking an arbitrarily shaped continuous ground curve. This tracking problem is formulated as one of controlling the shape of the curve in the image plane. We study the controllability of the system characterizing the dynamics of the image curve, and show that the shape of the image curve is controllable only up to its "linear" curvature parameters. We present stabilizing control laws for tracking piecewise analytic curves, and propose to track arbitrary curves by approximating them by piecewise "linear" curvature curves. Simulation results are given for these control schemes. Observability of the curve dynamics by using direct measurements from vision sensors as the outputs is studied and an extended Kalman filter is proposed to dynamically estimate the image quantities needed for feedback control from the actual noisy images.

[1]  Jerry M. Mendel,et al.  Lessons in digital estimation theory , 1986 .

[2]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[3]  Claude Samson,et al.  Robot Control: The Task Function Approach , 1991 .

[4]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Daniel Raviv,et al.  Nonreconstruction approach for road following , 1992, Other Conferences.

[6]  Andrew Blake,et al.  Surface Orientation and Time to Contact from Image Divergence and Deformation , 1992, ECCV.

[7]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[8]  S. Shankar Sastry,et al.  Stabilization of trajectories for systems with nonholonomic constraints , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[9]  S. Sastry,et al.  Trajectory generation for the N-trailer problem using Goursat normal form , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[10]  S. Sastry,et al.  Nonholonomic motion planning: steering using sinusoids , 1993, IEEE Trans. Autom. Control..

[11]  Richard M. Murray,et al.  Nilpotent bases for a class of nonintegrable distributions with applications to trajectory generation for nonholonomic systems , 1994, Math. Control. Signals Syst..

[12]  Pietro Perona,et al.  Recursive estimation of camera motion from uncalibrated image sequences , 1994, Proceedings of 1st International Conference on Image Processing.

[13]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[14]  Jitendra Malik,et al.  An integrated stereo-based approach to automatic vehicle guidance , 1995, Proceedings of IEEE International Conference on Computer Vision.

[15]  Giorgio Picci,et al.  On line path following by recursive spline updating , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[16]  John R. Hauser,et al.  Maneuver Regulation from Trajectory Tracking: Feedback Linearizable Systems * , 1995 .

[17]  B. Ghosh,et al.  A Perspective Theory for Motion and Shape Estimation in Machine Vision , 1995 .

[18]  Patrick Rives,et al.  Applying visual servoing techniques to control a mobile hand-eye system , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[19]  P. Perona,et al.  Motion estimation via dynamic vision , 1996, IEEE Trans. Autom. Control..

[20]  D. Tsakiris,et al.  VISION BASED TIME VARYING MOBILE ROBOT CONTROL D.P. TSAKIRIS, C. SAMSON, P. RIVES , 1996 .

[21]  S. Shankar Sastry,et al.  Vision guided navigation for a nonholonomic mobile robot , 1997, Block Island Workshop on Vision and Control.

[22]  Jana Kosecka,et al.  Vision-based lateral control of vehicles , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[23]  S. Sastry Nonlinear Systems: Analysis, Stability, and Control , 1999 .