Virtual Visual Servoing: a framework for real‐time augmented reality

This paper presents a framework to achieve real‐time augmented reality applications. We propose a framework based on the visual servoing approach well known in robotics. We consider pose or viewpoint computation as a similar problem to visual servoing. It allows one to take advantage of all the research that has been carried out in this domain in the past. The proposed method features simplicity, accuracy, efficiency, and scalability wrt. to the camera model as well as wrt. the features extracted from the image. We illustrate the efficiency of our approach on augmented reality applications with various real image sequences.

[1]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[2]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[3]  Kiriakos N. Kutulakos,et al.  Calibration-Free Augmented Reality , 1998, IEEE Trans. Vis. Comput. Graph..

[4]  Gregory D. Hager,et al.  Fast and Globally Convergent Pose Estimation from Video Images , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[6]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[7]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[8]  David G. Lowe,et al.  Three-Dimensional Object Recognition from Single Two-Dimensional Images , 1987, Artif. Intell..

[9]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .

[10]  Nicolas Courty,et al.  Image-Based Virtual Camera Motion Strategies , 2000, Graphics Interface.

[11]  Roberto Cipolla,et al.  Real-time tracking of complex structures with on-line camera calibration , 2002, Image Vis. Comput..

[12]  François Chaumette,et al.  A New Formulation for Non-Linear Camera Calibration Using Virtual Visual Servoing , 2001 .

[13]  Éric Marchand,et al.  VISP: a software environment for eye-in-hand visual servoing , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[14]  Michel Dhome,et al.  Determination of the Attitude of 3D Objects from a Single Perspective View , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Michal Ponder,et al.  Interaction between real and virtual humans: playing checkers , 2000 .

[16]  Patrick Bouthemy,et al.  Robust real-time visual tracking using a 2D-3D model-based approach , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[17]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[18]  Michel Dhome,et al.  Spatial Localization Of Modelled Objects Of Revolution In Monocular Perspective Vision , 1990, ECCV.

[19]  Marie-Odile Berger,et al.  Registration with a zoom lens camera for augmented reality applications , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[20]  Venkataraman Sundareswaran,et al.  Visual servoing-based augmented reality , 1999 .

[21]  Koichi Hashimoto,et al.  Visual Servoing: Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback , 1993 .

[22]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[23]  F DementhonDaniel,et al.  Model-based object pose in 25 lines of code , 1995 .

[24]  B. Benhabib,et al.  3D-pose estimation from a quadratic-curved feature in two perspective views , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[25]  Ivan Poupyrev,et al.  The MagicBook - Moving Seamlessly between Reality and Virtuality , 2001, IEEE Computer Graphics and Applications.