Pose estimation using line-based dynamic vision and inertial sensors

An observer problem from a computer vision application is studied. Rigid body pose estimation using inertial sensors and a monocular camera is considered and it is shown how rotation estimation can be decoupled from position estimation. Orientation estimation is formulated as an observer problem with implicit output where the states evolve on SO(3). A careful observability study reveals interesting group theoretic structures tied to the underlying system structure. A locally convergent observer where the states evolve on SO (3) is proposed and numerical estimates of the domain of attraction is given. Further, it is shown that, given convergent orientation estimates, position estimation can be formulated as a linear implicit output problem. From an applications perspective, it is outlined how delayed low bandwidth visual observations and high bandwidth rate gyro measurements can provide high bandwidth estimates. This is consistent with real-time constraints due to the complementary characteristics of the sensors which are fused in a multirate way.

[1]  Azad M. Madni,et al.  Solid-state six degree of freedom, motion sensor for field robotic applications , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[2]  Robert P. Smith,et al.  Gyroscopic data fusion via a quaternion-based complementary filter , 1997, Defense, Security, and Sensing.

[3]  Minas E. Spetsakis,et al.  Structure from motion using line correspondences , 1990, International Journal of Computer Vision.

[4]  P. Perona,et al.  Motion estimation via dynamic vision , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[5]  Fadi Dornaika,et al.  Pose Estimation using Point and Line Correspondences , 1999, Real Time Imaging.

[6]  A.-J. Baerveldt,et al.  A low-cost and low-weight attitude estimation system for an autonomous helicopter , 1997, Proceedings of IEEE International Conference on Intelligent Engineering Systems.

[7]  C. A. Desoer,et al.  Nonlinear Systems Analysis , 1978 .

[8]  John Oliensis,et al.  A Critique of Structure-from-Motion Algorithms , 2000, Comput. Vis. Image Underst..

[9]  Xiaoming Hu,et al.  Nonlinear pitch and roll estimation for walking robots , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[10]  Eric Foxlin,et al.  Inertial head-tracker sensor fusion by a complementary separate-bias Kalman filter , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[11]  Xiaoming Hu,et al.  Observers for systems with implicit output , 2000, IEEE Trans. Autom. Control..

[12]  Thomas S. Huang,et al.  Motion and structure from feature correspondences: a review , 1994, Proc. IEEE.

[13]  W. Boothby.  An introduction to differentiable manifolds and Riemannian geometry , 1975 .

[14]  E. J. Lefferts,et al.  Kalman Filtering for Spacecraft Attitude Estimation , 1982 .

[15]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[16]  John B. Fraleigh.  A first course in abstract algebra , 1967 .

[17]  Radu Horaud,et al.  Visual Servoing from Lines , 2002, Int. J. Robotics Res..

[18]  B. Ghosh,et al.  Visually guided ranging from observations of points, lines and curves via an identifier based nonlinear observer , 1995 .

[19]  J. Balaram.  Kinematic observers for articulated rovers , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[20]  Stéphane Christy,et al.  Iterative Pose Computation from Line Correspondences , 1999, Comput. Vis. Image Underst..

[21]  Marie-José Aldon,et al.  Mobile robot attitude estimation by fusion of inertial data , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[22]  Bijoy K. Ghosh,et al.  Multi-rate fusion of visual and inertial data , 2001, Conference Documentation International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI 2001 (Cat. No.01TH8590).

[23]  D. Koditschek.  The Application of Total Energy as a Lyapunov Function for Mechanical Control Systems , 1989 .

[24]  M. Greene.  A solid state attitude heading reference system for general aviation , 1996, Proceedings 1996 IEEE Conference on Emerging Technologies and Factory Automation. ETFA '96.

[25]  Stéphane Christy,et al.  Fast and Reliable Object Pose Estimation from Line Correspondences , 1997, CAIP.

[26]  Xiaoming Hu,et al.  Drift-free attitude estimation for accelerated rigid bodies , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[27]  Richard M. Murray,et al.  Tracking for fully actuated mechanical systems: a geometric framework , 1999, Autom..

[28]  Michael Harrington,et al.  Miniature six-DOF inertial system for tracking HMDs , 1998, Defense, Security, and Sensing.

[29]  Kosuke Sato,et al.  Human motion capture by integrating gyroscopes and accelerometers , 1996, 1996 IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems (Cat. No.96TH8242).

[30]  Minas E. Spetsakis.  A linear algorithm for point and line-based structure from motion , 1992, CVGIP Image Underst..

[31]  Hugh F. Durrant-Whyte,et al.  Inertial navigation systems for mobile robots , 1995, IEEE Trans. Robotics Autom..

[32]  Jorge Lobo,et al.  Integration of inertial information with vision , 1998, IECON '98. Proceedings of the 24th Annual Conference of the IEEE Industrial Electronics Society (Cat. No.98CH36200).

[33]  Paul M. Weichsel,et al.  A first course in abstract algebra , 1966 .

[34]  Xiaoming Hu,et al.  Nonlinear state estimation for rigid-body motion with low-pass sensors , 2000 .

[35]  Ryo Kurazume,et al.  Development of image stabilization system for remote operation of walking robots , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).