Dynamic superimposition of synthetic objects on rigid and simple-deformable real objects

A current challenge in augmented reality applications is the accurate superimposition of synthetic objects on real objects within the environment. This challenge is heightened when the real objects are in motion and/or are non-rigid. In this article, we present a robust method for real-time, optical superimposition of synthetic objects on dynamic, rigid and simple-deformable real objects. Moreover, we illustrate this general method with the VRDA Tool, a medical education application enabling the visualization of internal human knee joint anatomy on a real human knee. r 2002 Elsevier Science Ltd. All rights reserved.

[1]  V. K. Utyonkov,et al.  Voyage to Superheavy Island. , 2000 .

[2]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Warren Robinett,et al.  A Computational Model for the Stereoscopic Optics of a Head-Mounted Display , 1991, Presence: Teleoperators & Virtual Environments.

[4]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[5]  Greg Welch,et al.  SCAAT: incremental tracking with incomplete information , 1997, SIGGRAPH.

[6]  C. Spoor,et al.  Rigid body motion calculated from spatial co-ordinates of markers. , 1980, Journal of biomechanics.

[7]  Parravano Jg,et al.  Postprocessing conventional vs. fast spin echo MR images. , 1995 .

[8]  Daphna Weinshall,et al.  Motion of disturbances: detection and tracking of multi-body non-rigid motion , 1999, Machine Vision and Applications.

[9]  G. Stewart.  Introduction to matrix computations , 1973 .

[10]  Takeo Kanade,et al.  Vision-Based Object Registration for Real-Time Image Overlay , 1995, CVRMed.

[11]  Brigid Barron,et al.  Tools to enhance math education: the Jasper series , 1993, CACM.

[12]  Mark A. Livingston,et al.  Superior augmented reality registration by integrating landmark tracking and magnetic tracking , 1996, SIGGRAPH.

[13]  Jannick P. Rolland,et al.  Towards Quantifying Depth and Size Perception in Virtual Environments , 1993, Presence: Teleoperators & Virtual Environments.

[14]  Larry S. Davis,et al.  Technologies for Augmented Reality: Calibration for Real-Time Superimposition on Rigid and Simple-Deformable Real Objects , 2001, MICCAI.

[15]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[16]  Ulrich Neumann,et al.  Dynamic registration correction in video-based augmented reality systems , 1995, IEEE Computer Graphics and Applications.

[17]  Jennifer Healey,et al.  Augmented Reality through Wearable Computing , 1997, Presence: Teleoperators & Virtual Environments.

[18]  Hirokazu Kato,et al.  Collaborative Mixed Reality , 1999 .

[19]  U.D. Croce,et al.  Surface-marker cluster design criteria for 3-D bone movement reconstruction , 1997, IEEE Transactions on Biomedical Engineering.

[20]  Eric Foxlin,et al.  Inertial head-tracker sensor fusion by a complementary separate-bias Kalman filter , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[21]  Marcel Rooze,et al.  Visualization of Combined Motions in Human Joints , 1998, IEEE Computer Graphics and Applications.

[22]  Henry Fuchs,et al.  Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization , 2000, Presence: Teleoperators & Virtual Environments.

[23]  Larry S. Davis,et al.  Dynamic superimposition of synthetic objects on rigid and simple-deformable real objects , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[24]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[25]  Larry F. Hodges,et al.  Generating exact ray-traced animation frames by reprojection , 1995, IEEE Computer Graphics and Applications.

[26]  R. Kikinis,et al.  Image-guided surgery. , 1999 .

[27]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.

[28]  J P Rolland,et al.  Engineering of head-mounted projective displays. , 2000, Applied optics.

[29]  Kuo-Chi Lin,et al.  Automatic Modeling of Knee-Joint Motion For The Virtual Reality Dynamic Anatomy (VRDA) Tool , 2000, Presence: Teleoperators & Virtual Environments.

[30]  Jannick P. Rolland,et al.  Method of Adjustments versus Method of Constant Stimuli in the Quantification of Accuracy and Precision of Rendered Depth in Head-Mounted Displays , 2002, Presence: Teleoperators & Virtual Environments.

[31]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[32]  Ronald Azuma,et al.  Improving static and dynamic registration in an optical see-through HMD , 1994, SIGGRAPH.

[33]  J. Rolland,et al.  Using virtual reality to teach radiographic positioning. , 1995, Radiologic technology.