Vision guided navigation for a nonholonomic mobile robot

Visual servoing, i.e. the use of the vision sensor in feedback control, has been of increasing interest. Work has been done on applications in autonomous driving, manipulation, mobile robot navigation and surveillance. This paper studies the navigation task for a nonholonomic ground mobile base tracking an arbitrarily shaped ground curve using vision sensors. This tracking problem is formulated as one of controlling the shape of the curve in the image plane. The study of the controllability of the system characterizing the image curve dynamics shows that the shape of the image curve is controllable only up to its "linear" curvature parameters. A stabilizing control law is presented for tracking (piecewise) analytic curves, and we propose to track arbitrary curves by approximating them by piecewise linear curvature curves. Simulation results are given for these control schemes. The observability of the image curve dynamics using direct measurements from vision sensors as the outputs is studied and an extended Kalman filter is proposed to dynamically estimate the image parameters needed for the feedback control from the actual noisy image sequences.

[1]  Richard M. Murray,et al.  Nilpotent bases for a class of nonintegrable distributions with applications to trajectory generation for nonholonomic systems , 1994, Math. Control. Signals Syst..

[2]  R. Murray,et al.  Trajectory generation for the N-trailer problem using Goursat normal form , 1995 .

[3]  Patrick Rives,et al.  Applying visual servoing techniques to control a mobile hand-eye system , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[4]  P. Perona,et al.  Motion estimation via dynamic vision , 1996, IEEE Trans. Autom. Control..

[5]  C. A. Desoer,et al.  Nonlinear Systems Analysis , 1978 .

[6]  Jitendra Malik,et al.  An integrated stereo-based approach to automatic vehicle guidance , 1995, Proceedings of IEEE International Conference on Computer Vision.

[7]  A. Jazwinski.  Stochastic Processes and Filtering Theory , 1970 .

[8]  Giorgio Picci,et al.  On line path following by recursive spline updating , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[9]  Jerry M. Mendel,et al.  Lessons in digital estimation theory , 1986 .

[10]  Andrew Blake,et al.  Surface Orientation and Time to Contact from Image Divergence and Deformation , 1992, ECCV.

[11]  Jana Kosecka,et al.  Vision-based lateral control of vehicles , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[12]  Pietro Perona,et al.  Recursive estimation of camera motion from uncalibrated image sequences , 1994, Proceedings of 1st International Conference on Image Processing.

[13]  S. Sastry,et al.  Nonholonomic motion planning: steering using sinusoids , 1993, IEEE Trans. Autom. Control..

[14]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  S. Sastry,et al.  Stabilization of trajectories for systems with nonholonomic constraints , 1994 .

[16]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[17]  A. Isidori.  Nonlinear Control Systems , 1985 .

[18]  Claude Samson,et al.  Robot Control: The Task Function Approach , 1991 .

[19]  Daniel Raviv,et al.  Nonreconstruction approach for road following , 1992, Other Conferences.

[20]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[21]  B. Ghosh,et al.  A Perspective Theory for Motion and Shape Estimation in Machine Vision , 1995 .