Color-Based Monocular Visuoinertial 3-D Pose Estimation of a Volant Robot

The pose estimation from visual sensors is widely practiced nowadays. The pose vector is estimated by means of homographies and projection geometry. The integration of visual and inertial measurements is getting more attractive due to its robustness and flexibility. The cooperation of visual with inertial sensors for finding a robot's pose bears many advantages, as it exploits their complementary attributes. Most of the visual pose estimation systems identify a geometrically known planar target to extract the pose vector. In this paper, the pose is estimated from a set of colored markers arranged in a known geometry, fused with the measurements of an inertial unit. The utilization of an extended Kalman filter (EKF) compensates the error and fuses the two heterogeneous measurements. The novelty of the proposed system is the use of low-cost colored post-it markers, along with the capability of handling different frames of reference, as the camera and the inertial unit are mounted on different mobile subsystems of a sophisticated volant robotic platform. The proposed system is computationally inexpensive, operates in real time, and exhibits high accuracy.

[1]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[2]  Patrick Pérez,et al.  Color-Based Probabilistic Tracking , 2002, ECCV.

[3]  Antonios Gasteratos,et al.  Pose estimation of a volant platform with a monocular visuo-inertial system , 2009, 2009 IEEE International Workshop on Imaging Systems and Techniques.

[4]  Nassir Navab,et al.  Distance transform templates for object detection and pose estimation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Yiannis Aloimonos,et al.  Perspective approximations , 1990, Image Vis. Comput..

[6]  Axel Pinz,et al.  Robust Pose Estimation from a Planar Target , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Federico Tombari,et al.  Full-Search-Equivalent Pattern Matching with Incremental Dissimilarity Approximations , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jing Zhang,et al.  An Improved Pose Estimation Algorithm For Real-time Vision Applications , 2006, 2006 International Conference on Communications, Circuits and Systems.

[9]  Fadi Dornaika,et al.  Object Pose: The Link between Weak Perspective, Paraperspective, and Full Perspective , 1997, International Journal of Computer Vision.

[10]  Shai Avidan,et al.  Support vector tracking , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Andrew C. Gallagher Using vanishing points to correct camera rotation in images , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[12]  Vincent Lepetit,et al.  Keypoint recognition using randomized trees , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[14]  Sinisa Segvic,et al.  Determining the absolute orientation in a corridor using projective geometry and active vision , 2001, IEEE Trans. Ind. Electron..

[15]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[16]  Jorge Dias,et al.  Vision and Inertial Sensor Cooperation Using Gravity as a Vertical Reference , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Andrew C. Gallagher A ground truth based vanishing point detection algorithm , 2002, Pattern Recognit..

[18]  J. L. Roux An Introduction to the Kalman Filter , 2003 .

[19]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[20]  Takeo Kanade,et al.  A Paraperspective Factorization Method for Shape and Motion Recovery , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Jiri Matas,et al.  Tracking by an Optimal Sequence of Linear Predictors , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  P. Rouchon,et al.  Fusion of inertial and visual: a geometrical observer‐based approach , 2009 .

[23]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[24]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[25]  Peter F. Sturm,et al.  Using geometric constraints through parallelepipeds for calibration and 3D modeling , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Gunnar Bolmsjö,et al.  ACROBOTER: a ceiling based crawling, hoisting and swinging service robot platform , 2009 .

[27]  Kostas Daniilidis,et al.  Linear Pose Estimation from Points or Lines , 2002, ECCV.

[28]  Gregory D. Hager,et al.  Fast and Globally Convergent Pose Estimation from Video Images , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Bijoy K. Ghosh,et al.  Pose estimation using line-based dynamic vision and inertial sensors , 2003, IEEE Trans. Autom. Control..