Technologies for Augmented Reality: Calibration for Real-Time Superimposition on Rigid and Simple-Deformable Real Objects

A current challenge in augmented reality applications is the ability to superimpose synthetic objects on real objects within the environment. This challenge is heightened when the real objects are in motion and/or are non-rigid. Yet even more challenging is the case when the moving real objects involved are deformable. In this article, we present a robust method for calibrating marker-based augmented reality applications to allow real-time, optical superimposition of synthetic objects on dynamic rigid and simple-deformable real objects. Moreover, we illustrate this general method with the VRDA Tool, a medical education application related to the visualization of internal human knee joint anatomy on a real human knee.

[1]  Kuo-Chi Lin,et al.  Automatic Modeling of Knee-Joint Motion For The Virtual Reality Dynamic Anatomy (VRDA) Tool , 2000, Presence: Teleoperators & Virtual Environments.

[2]  Angelo Cappello,et al.  Multiple anatomical landmark calibration for optimal bone pose estimation , 1997 .

[3]  Jannick P. Rolland,et al.  Optical versus Video See-Through Head-Mounted Displays , 2001 .

[4]  Parravano Jg,et al.  Postprocessing conventional vs. fast spin echo MR images. , 1995 .

[5]  T P Andriacchi,et al.  A point cluster method for in vivo motion analysis: applied to a study of knee kinematics. , 1998, Journal of biomechanical engineering.

[6]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Henry Fuchs,et al.  Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization , 2000, Presence: Teleoperators & Virtual Environments.

[8]  I Söderkvist,et al.  Determining the movements of the skeleton using well-configured markers. , 1993, Journal of biomechanics.

[9]  J P Rolland,et al.  Engineering of head-mounted projective displays. , 2000, Applied optics.

[10]  J. Rolland,et al.  Using virtual reality to teach radiographic positioning. , 1995, Radiologic technology.

[11]  Warren Robinett,et al.  The Visual Display Transformation for Virtual Reality , 1995, Presence: Teleoperators & Virtual Environments.

[12]  Larry S. Davis,et al.  Dynamic superimposition of synthetic objects on rigid and simple-deformable real objects , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[13]  C. Spoor,et al.  Rigid body motion calculated from spatial co-ordinates of markers. , 1980, Journal of biomechanics.

[14]  Jannick P. Rolland,et al.  Towards Quantifying Depth and Size Perception in Virtual Environments , 1993, Presence: Teleoperators & Virtual Environments.