Visual gyroscope: Integration of visual information with gyroscope for attitude measurement of mobile platform

In this paper, fusion of visual and inertial information is proposed for attitude measurement of remotely-operated mobile robots. The primary objective is to eliminate the drift error of the inertial sensors using visual information for exact and fast sensing of attitude. By this fusion each output is not only combined together but also helps the other yield better result. The environment is assumed unknown and corner features are utilized for rotation matrix calculation, for corners are better extracted in nature scene than lines. The measured information is to be used for stabilizing the image sent to the operator and for stabilizing the robot body itself in bumpy terrain. In the paper, the fusion algorithm based on Kalman filter is utilized, and its performance is evaluated by experiment. For the experiment, high performance camera is used with low-quality gyro sensors. The experimental results show that the vision algorithm well tracks the attitude change of the camera, and by fusing that with gyro sensor output, we could get high rate angle measurement without drift error.

[1]  Xiaoming Hu,et al.  Drift-free attitude estimation for accelerated rigid bodies , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[2]  Ryo Kurazume,et al.  Development of image stabilization system for remote operation of walking robots , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[3]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Suya You,et al.  Fusion of vision and gyro tracking for robust augmented reality registration , 2001, Proceedings IEEE Virtual Reality 2001.

[5]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[6]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[7]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice , 1993 .

[8]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[9]  Niels Kjølstad Poulsen,et al.  Incorporation of time delayed measurements in a discrete-time Kalman filter , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[10]  Oliver J. Woodman,et al.  An introduction to inertial navigation , 2007 .

[11]  Xiaoming Hu,et al.  Nonlinear pitch and roll estimation for walking robots , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[12]  Bijoy K. Ghosh,et al.  Pose estimation using line-based dynamic vision and inertial sensors , 2003, IEEE Trans. Autom. Control..

[13]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .