Pose estimation for augmented reality applications using genetic algorithm

This paper describes a genetic algorithm that tackles the pose-estimation problem in computer vision. Our genetic algorithm can find the rotation and translation of an object accurately when the three-dimensional structure of the object is given. In our implementation, each chromosome encodes both the pose and the indexes to the selected point features of the object. Instead of only searching for the pose as in the existing work, our algorithm, at the same time, searches for a set containing the most reliable feature points in the process. This mismatch filtering strategy successfully makes the algorithm more robust under the presence of point mismatches and outliers in the images. Our algorithm has been tested with both synthetic and real data with good results. The accuracy of the recovered pose is compared to the existing algorithms. Our approach outperformed the Lowe's method and the other two genetic algorithms under the presence of point mismatches and outliers. In addition, it has been used to estimate the pose of a real object. It is shown that the proposed method is applicable to augmented reality applications.

[1]  Ulrich Neumann,et al.  Vision-based pose computation: robust and accurate augmented reality tracking , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[2]  Kin Hong Wong,et al.  Pose estimation using four corresponding points , 1999, Pattern Recognit. Lett..

[3]  Vincenzo Lippiello,et al.  Objects motion estimation via BSP tree modeling and Kalman filtering of stereo images , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[4]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[6]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[7]  Kin Hong Wong,et al.  An efficient iterative pose estimation algorithm , 1998, Image Vis. Comput..

[8]  Pietro Cerveri,et al.  Combined evolution strategies for dynamic calibration of video-based measurement systems , 2001, IEEE Trans. Evol. Comput..

[9]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice , 1993 .

[10]  Vincenzo Lippiello,et al.  Position and orientation estimation based on Kalman filtering of stereo images , 2001, Proceedings of the 2001 IEEE International Conference on Control Applications (CCA'01) (Cat. No.01CH37204).

[11]  Radu Horaud,et al.  An analytic solution for the perspective 4-point problem , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  S. Sengupta,et al.  Robust camera parameter estimation using genetic algorithm , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[13]  Kin Hong Wong,et al.  Model reconstruction and pose acquisition using extended Lowe's method , 2005, IEEE Transactions on Multimedia.

[14]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[15]  Paul A. Beardsley,et al.  Sequential Updating of Projective and Affine Structure from Motion , 1997, International Journal of Computer Vision.

[16]  Qiang Ji,et al.  Camera calibration with genetic algorithms , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[17]  Kin Hong Wong,et al.  POSE TRACKING FOR VIRTUAL WALK-THROUGH ENVIRONMENT CONSTRUCTION , 2003 .

[18]  Toby Howard,et al.  Accurate camera calibration for off-line, video-based augmented reality , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[19]  Nassir Navab,et al.  Taking AR into large scale industrial environments: navigation and information access with mobile computers , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[20]  Kenji Shoji,et al.  Model-based pose estimation using genetic algorithm , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[21]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[22]  Richard Szeliski,et al.  Shape Ambiguities in Structure From Motion , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[24]  Nassir Navab,et al.  Visual marker detection and decoding in AR systems: a comparative study , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.