Multi-rate fusion of visual and inertial data

We present a method for fusing data from a vision system and an inertial measurement unit. The problem considered is that of pose estimation for a rapidly moving camera, and we show that given delayed low bandwidth visual observations of line correspondences and high bandwidth rate gyro measurements we are able to estimate the camera orientation with respect to an inertial frame. This can be done without knowing or estimating the camera position. The estimates are of high bandwidth and this is consistent with real-time constraints due to the complementary characteristics of the two sensors which are fused in a multi-rate way. The algorithm has interesting mathematical properties as it does not use any local parameterization of the orientation such as Euler angles. Instead, the state estimates evolve on the group of rotation matrices.

[1]  Marie-José Aldon,et al.  Mobile robot attitude estimation by fusion of inertial data , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[2]  Eric Foxlin,et al.  Inertial head-tracker sensor fusion by a complementary separate-bias Kalman filter , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[3]  Radu Horaud,et al.  An analytic solution for the perspective 4-point problem , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Xiaoming Hu,et al.  Drift-free attitude estimation for accelerated rigid bodies , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[5]  Xiaoming Hu,et al.  Nonlinear pitch and roll estimation for walking robots , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[6]  Ryo Kurazume,et al.  Development of image stabilization system for remote operation of walking robots , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[7]  B. Ghosh,et al.  Visually guided ranging from observations of points, lines and curves via an identifier based nonlinear observer , 1995 .

[8]  Radu Horaud,et al.  Visual Servoing from Lines , 2002, Int. J. Robotics Res..