GPU-assisted 3D Pose Estimation under realistic illumination

This paper describes an approach which combines computer vision methods with techniques from the area of computer graphics. This method which is called analysis-by-synthesis explicitly seeks for consideration of environmental information in order to improve the resulting estimation of the 3D camera pose. In this paper, two different kinds of pose estimation will be presented. The first approach uses intensity-based methods and the second one is a feature point-based approach. The described approaches are based on a GPU-assisted rendering considering the real world illumination. These real world lighting conditions are captured using a HDR sampling technique. The results of this GPU-assisted approach are that both methods, the intensity-based as well as the feature point-based method, achieve better results in terms of a more robust and stable 3D camera pose under consideration of the real environmental information.

[1]  T. Drummond,et al.  Going out : Robust Tracking for Outdoor Augmented Reality , 2006 .

[2]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[3]  David J. Hawkes,et al.  2D-3D Intensity Based Registration of DSA and MRA - A Comparison of Similarity Measures , 2002, MICCAI.

[4]  Shane Xie,et al.  Comparison of local descriptors for image registration of geometrically-complex 3D scenes , 2007, 2007 14th International Conference on Mechatronics and Machine Vision in Practice.

[5]  Didier Stricker,et al.  Tracking with reference images: a real-time and markerless tracking solution for out-door augmented reality applications , 2001, VAST '01.

[6]  Alexander Keller,et al.  Efficient Illumination by High Dynamic Range Images , 2003, Rendering Techniques.

[7]  Vincent Lepetit,et al.  Fully automated and stable registration for augmented reality applications , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[8]  Neil Hunt,et al.  The triangle processor and normal vector shader: a VLSI system for high performance graphics , 1988, SIGGRAPH.

[9]  Takafumi Saito,et al.  Comprehensible rendering of 3-D shapes , 1990, SIGGRAPH.

[10]  Bodo Rosenhahn,et al.  Texture driven pose estimation , 2005, International Conference on Computer Graphics, Imaging and Visualization (CGIV'05).

[11]  Didier Stricker,et al.  Adaptive line tracking with multiple hypotheses for augmented reality , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[12]  Didier Stricker,et al.  Advanced tracking through efficient image processing and visual-inertial sensor fusion , 2008, 2008 IEEE Virtual Reality Conference.

[13]  S. Müller,et al.  Analysis by Synthesis Techniques for Markerless Tracking , 2012 .