Image-based visual servo control of aerial robotic systems using linear image features

An image-based "eye-in-hand" visual servo-control design is proposed for underactuated rigid-body dynamics. The dynamic model considered is motivated by recent work on vertical takeoff and landing aerial robotic vehicles. The task considered is that of tracking parallel linear visual features. The proposed design exploits the geometry of the task considered and passivity-like properties of rigid-body dynamics to derive a control Lyapunov function using backstepping techniques.

[1]  Takeo Kanade,et al.  Vision-Based Autonomous Helicopter Research at Carnegie Mellon Robotics Institute 1991-1997 , 1998 .

[2]  Gregory D. Hager,et al.  VisionBased Autonomous Helicopter Research at Carnegie Mellon Robotics Institute (19911998) , 2000 .

[3]  M.S. de Queiroz,et al.  Robust visual-servo control of robot manipulators in the presence of uncertainty , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[4]  E. Feron,et al.  Real-time motion planning for agile autonomous vehicles , 2000, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[5]  Gregory D. Hager,et al.  Robust Vision for Vision-Based Control of Motion , 1999 .

[6]  P. K. Khosla,et al.  Adaptive Robotic Visual Tracking , 1991, 1991 American Control Conference.

[7]  James P. Ostrowski,et al.  Visual motion planning for mobile robots , 2002, IEEE Trans. Robotics Autom..

[8]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[9]  J. Plucker.  I. On a new geometry of space , Proceedings of the Royal Society of London.

[10]  Robert E. Mahony,et al.  Visual servoing of an under-actuated dynamic rigid-body system: an image-based approach , 2002, IEEE Trans. Robotics Autom..

[11]  A. Teel.  A nonlinear small gain theorem for the analysis of control systems with saturation , 1996, IEEE Trans. Autom. Control..

[12]  M. Fujita,et al.  Visual feedback control of rigid body motion base on dissipation theoretical approach , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[13]  Bernard Espiau,et al.  Effect of Camera Calibration Errors on Visual Servoing in Robotics , 1993, ISER.

[14]  Rogelio Lozano,et al.  DYNAMIC MODELLING AND CONFIGURATION STABILIZATION FOR AN X4-FLYER. , 2002 .

[15]  Claude Samson,et al.  Robot Control: The Task Function Approach , 1991 .

[16]  Rachid Outbib,et al.  Semidefinite lyapunov functions stability and stabilization , 1996, Math. Control. Signals Syst..

[17]  H. Pottmann,et al.  Approximation in Line Space — Applications in Robot Kinematics and Surface Reconstruction , 1998 .

[18]  Robert E. Mahony,et al.  Visual servoing using linear features for under-actuated rigid body dynamics , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[19]  P. Khosla,et al.  Image-based visual servoing of nonholonomic mobile robots , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[20]  Bernard Mettler,et al.  Identification Modeling and Characteristics of Miniature Rotorcraft , 2002 .

[21]  Gaurav S. Sukhatme,et al.  Vision-based autonomous landing of an unmanned aerial vehicle , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[22]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[23]  S. Sastry,et al.  Output tracking control design of a helicopter model based on approximate linearization , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[24]  S. Shankar Sastry,et al.  c ○ 2000 Kluwer Academic Publishers. Manufactured in The Netherlands. Linear Differential Algorithm for Motion Recovery: A Geometric Approach , 2022 .

[25]  Patrick Rives,et al.  Applying visual servoing techniques to control a mobile hand-eye system , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[26]  Emilio Frazzoli,et al.  Trajectory tracking control design for autonomous helicopters using a backstepping algorithm , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[27]  B. Espiau,et al.  Revisiting Plücker Coordinates in Vision-Based Control , 2002 .

[28]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[29]  Robert E. Mahony,et al.  Control of a quadrotor helicopter using visual feedback , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[30]  H. Lipkin,et al.  A dynamic quasi-newton method for model independent visual servoing , 1999 .

[31]  Naomi Ehrich Leonard.  Stability of a bottom-heavy underwater vehicle , 1997, Autom..

[32]  Mark W. Spong,et al.  Robot dynamics and control , 1989 .

[33]  Svetha Venkatesh,et al.  Robot navigation inspired by principles of insect vision , 1999, Robotics Auton. Syst..

[34]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[35]  Tarek Hamel,et al.  Hover control via Lyapunov control for an autonomous model helicopter , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[36]  Rafael Castro-Linares,et al.  A Liouvillian systems approach for the trajectory planning-based control of helicopter models , 2000 .

[37]  Minoru Asada,et al.  Versatile visual servoing without knowledge of true Jacobian , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[38]  R. Lozano,et al.  DYNAMIC MODELLING AND CONFIGURATION STABILIZATION FOR AN X 4-FLYER , 2002 .

[39]  Linda G. Shapiro,et al.  Computer Vision , 2001 .

[40]  Lorenzo Marconi,et al.  Robust nonlinear motion control of a helicopter , 2003, IEEE Trans. Autom. Control..

[41]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[42]  James P. Ostrowski,et al.  Visual servoing with dynamics: control of an unmanned blimp , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[43]  P. Perona,et al.  Structure-independent visual motion control on the essential manifold , 1994 .

[44]  Patrick Rives,et al.  Visual servo control for the hovering of all outdoor robotic airship , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[45]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..