A Nonlinear Attitude Observer Based on Active Vision and Inertial Measurements

This paper presents an experimentally evaluated solution to the problem of estimating the attitude of a rigid body using rate gyros and a pan-tilt camera. A nonlinear attitude observer combines angular velocity measurements obtained from rate gyros with images of a planar scene provided by the camera. By directly exploiting the sensor information, a stabilizing feedback law is introduced, and exponential convergence to the origin of the estimation errors is shown. Additionally, an active-vision system is proposed that relies on an image-based exponentially input-to-state-stable control law for the pan and tilt angular rates of the camera to keep the features in the image plane. Using recent results in geometric numerical integration, a multirate implementation of the observer is proposed, which exploits the complementary bandwidth of the sensors. Practical considerations, such as the lens-distortion compensation and the computation of suitable observer feedback gains, are considered. Experimental results obtained with a high-accuracy motion rate table demonstrate the high level of performance attained by the proposed solution.

[1]  Brynjulf Owren,et al.  Order conditions for commutator-free Lie group methods , 2006 .

[2]  H. Munthe-Kaas Runge-Kutta methods on Lie groups , 1998 .

[3]  Robert M. Sanner,et al.  A coupled nonlinear spacecraft attitude controller and observer with an unknown constant gyro bias and gyro noise , 2003, IEEE Trans. Autom. Control..

[4]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[5]  Rita Cunha,et al.  Landmark based nonlinear observer for rigid body attitude and position estimation , 2007, 2007 46th IEEE Conference on Decision and Control.

[6]  Bijoy K. Ghosh,et al.  Pose estimation using line-based dynamic vision and inertial sensors , 2003, IEEE Trans. Autom. Control..

[7]  Eduardo Sontag,et al.  Global Stabilization for Systems Evolving on Manifolds , 2004 .

[8]  Avinash C. Kak,et al.  A New Kalman-Filter-Based Framework for Fast and Accurate Visual Tracking of Rigid Objects , 2008, IEEE Transactions on Robotics.

[9]  Elena Celledoni,et al.  Commutator-free Lie group methods , 2003, Future Gener. Comput. Syst..

[10]  Rita Cunha,et al.  Nonlinear attitude estimation using active vision and inertial measurements , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[11]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[12]  E. Hairer,et al.  Geometric Numerical Integration: Structure Preserving Algorithms for Ordinary Differential Equations , 2004 .

[13]  J F Vasconcelos,et al.  Experimental evaluation of a nonlinear attitude observer based on image and inertial measurements , 2010, Proceedings of the 2010 American Control Conference.

[14]  Robert E. Mahony,et al.  Nonlinear Complementary Filters on the Special Orthogonal Group , 2008, IEEE Transactions on Automatic Control.

[15]  Hellward Broszio,et al.  Robust line-based calibration of lens distortion from a single view , 2003 .

[16]  Jorge Dias,et al.  Vision and Inertial Sensor Cooperation Using Gravity as a Vertical Reference , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  G. Wahba A Least Squares Estimate of Satellite Attitude , 1965 .

[18]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision: From Images to Geometric Models , 2003 .

[19]  Antonio Loría,et al.  Uniform exponential stability of linear time-varying systems: revisited , 2002, Syst. Control. Lett..

[20]  M. Innocenti,et al.  Stability considerations in quaternion attitude control using discontinuous Lyapunov functions , 2004 .

[21]  J. Douglas Faires,et al.  Numerical Analysis , 1981 .

[22]  S. Hutchinson,et al.  Visual Servo Control Part II : Advanced Approaches , 2007 .

[23]  C. Budd,et al.  Geometric integration and its applications , 2003 .

[24]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[25]  Jonghoon Park,et al.  Geometric integration on Euclidean group with application to articulated multibody systems , 2005, IEEE Transactions on Robotics.

[26]  Arne Marthinsen,et al.  Runge-Kutta Methods Adapted to Manifolds and Based on Rigid Frames , 1999 .

[27]  J. Miller Numerical Analysis , 1966, Nature.

[28]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[29]  P. Crouch,et al.  Numerical integration of ordinary differential equations on manifolds , 1993 .

[30]  Stergios I. Roumeliotis,et al.  Vision-Aided Inertial Navigation for Spacecraft Entry, Descent, and Landing , 2009, IEEE Transactions on Robotics.

[31]  N. McClamroch,et al.  Almost global attitude stabilization of an orbiting satellite including gravity gradient and control saturation effects , 2006, 2006 American Control Conference.

[32]  Paulo Jorge Ramalho Oliveira,et al.  A Single Pan and Tilt Camera Architecture for Indoor Positioning and Tracking , 2009, VISAPP.

[33]  Graziano Chesi,et al.  Visual servoing for large camera displacements , 2004, IEEE Transactions on Robotics.

[34]  S. Bhat,et al.  A topological obstruction to continuous global stabilization of rotational motion and the unwinding phenomenon , 2000 .