Recent Advances in Augmented Reality

In 1997, Azuma published a survey on augmented reality (AR). Our goal is to complement, rather than replace, the original survey by presenting representative examples of the new advances. We refer one to the original survey for descriptions of potential applications (such as medical visualization, maintenance and repair of complex equipment, annotation, and path planning); summaries of AR system characteristics (such as the advantages and disadvantages of optical and video approaches to blending virtual and real, problems in display focus and contrast, and system portability); and an introduction to the crucial problem of registration, including sources of registration error and error-reduction strategies.

[1]  Kiriakos N. Kutulakos,et al.  Calibration-Free Augmented Reality , 1998, IEEE Trans. Vis. Comput. Graph..

[2]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[3]  Gavin S. P. Miller,et al.  A real-time low-latency hardware light-field renderer , 1999, SIGGRAPH.

[4]  William M. Wells,et al.  Medical Image Computing and Computer-Assisted Intervention — MICCAI’98 , 1998, Lecture Notes in Computer Science.

[5]  A. Takagi,et al.  Development of a stereo video see-through HMD for AR systems , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[6]  Frederick P. Brooks.  What's Real About Virtual Reality? , 1999, IEEE Computer Graphics and Applications.

[7]  J. Urgen Stauder.  Augmented Reality with Automatic Illumination Control Incorporating Ellipsoidal Models , 1999 .

[8]  Andrew W. Fitzgibbon,et al.  Markerless tracking using planar structures in the scene , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[9]  Frank Biocca,et al.  An ultra-light and compact design and implementation of head-mounted projective displays , 2001, Proceedings IEEE Virtual Reality 2001.

[10]  Nassir Navab,et al.  Scene augmentation via the fusion of industrial drawings and uncalibrated images with a view to marker-less calibration , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[11]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .

[12]  Simon J. Julier,et al.  The software architecture of a real-time battlefield visualization virtual environment , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[13]  田村 秀行,et al.  Mixed reality : merging real and virtual worlds , 1999 .

[14]  J. Rekimoto,et al.  Transvision: a hand-held augmented reality system for collaborative design , 1996 .

[15]  Ivan Poupyrev,et al.  The MagicBook - Moving Seamlessly between Reality and Virtuality , 2001, IEEE Computer Graphics and Applications.

[16]  George A. Bekey,et al.  Compensation for end to end delays in a VR system , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[17]  T. Sugihara,et al.  32.4: A Lightweight 3‐D HMD with Accommodative Compensation , 1998 .

[18]  Noa M. Rensing,et al.  Eyeglass-based systems for wearable computing , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[19]  Jannick P. Rolland,et al.  Optical versus Video See-Through Head-Mounted Displays , 2001 .

[20]  Reinhold Behringer,et al.  Registration for outdoor augmented reality applications using computer vision techniques and hybrid sensors , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[21]  Steven K. Feiner,et al.  Situated documentaries: embedding multimedia presentations in the real world , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[22]  Greg Welch,et al.  Table-top spatially-augmented realty: bringing physical models to life with projected imagery , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[23]  Michael Gervautz,et al.  The Personal Interaction Panel – a Two‐Handed Interface for Augmented Reality , 1997, Comput. Graph. Forum.

[24]  Mark A. Livingston,et al.  Managing latency in complex augmented reality systems , 1997, SI3D.

[25]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[26]  Ronald Azuma,et al.  A motion-stabilized outdoor augmented reality system , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[27]  Takeo Kanade,et al.  Virtualized Reality : Digitizing a 3D Time-Varying Event As Is and in Real Time , 1999 .

[28]  Tyrone L. Vincent,et al.  An adaptive estimator for registration in augmented reality , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[29]  Laurent Vaissie,et al.  Accuracy of rendered depth in head-mounted displays: role of eyepoint location , 2000, Defense, Security, and Sensing.

[30]  Mark Billinghurst,et al.  Shared space: collaborative augmented reality , 1999, International Conference on Computer Graphics and Interactive Techniques.

[31]  Jun Rekimoto,et al.  Augmented surfaces: a spatially continuous work space for hybrid computing environments , 1999, CHI '99.

[32]  Rick Cavallaro,et al.  The FoxTrax Hockey Puck Tracking System , 1997, IEEE Computer Graphics and Applications.

[33]  Bruce H. Thomas,et al.  ARQuake: an outdoor/indoor augmented reality first person application , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[34]  Yuichi Ohta,et al.  Share-Z: Client/Server Depth Sensing for See-Through Head-Mounted Displays , 2002, Presence: Teleoperators & Virtual Environments.

[35]  Steve Mann,et al.  Telepointer: Hands-free completely self-contained wearable visual augmented reality without headwear and without any infrastructural reliance , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[36]  Michael Harrington,et al.  Constellation: a wide-range wireless motion-tracking system for augmented reality and virtual set applications , 1998, SIGGRAPH.

[37]  Ronald Azuma,et al.  Autocalibration of an electronic compass in an outdoor augmented reality system , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[38]  Vincent Lepetit,et al.  Handling occlusion in augmented reality systems: a semi-automatic method , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[39]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[40]  Masahiko Inami,et al.  Visuo-haptic display using head-mounted projector , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[41]  Volker Coors,et al.  Matching buildings: pose estimation in an urban environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[42]  Hiroshi Ishii,et al.  Illuminating light: an optical design tool with a luminous-tangible interface , 1998, CHI.

[43]  Ryugo Kijima,et al.  A Development of Reflex HMD - HMD with time delay compensation capability , 2001 .

[44]  Michael Gervautz,et al.  Occlusion in collaborative augmented environments , 1999, Comput. Graph..

[45]  Steven K. Feiner,et al.  View management for virtual and augmented reality , 2001, UIST '01.

[46]  Steven K. Feiner,et al.  Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system , 1999, Comput. Graph..

[47]  Suzanne Weghorst,et al.  Augmented reality and Parkinson's disease , 1997, CACM.

[48]  Ioannis T. Christou,et al.  Design and development issues for ARCHEOGUIDE: An Augmented Reality based cultural heritage on-site guide , 2001 .

[49]  T. Ronald,et al.  Azuma A Survey of Augmented Reality , 2022 .

[50]  Blair MacIntyre,et al.  Ghosts in the Machine: Integrating 2D Video Actors into a 3D AR System , 2001 .

[51]  Suya You,et al.  Camera tracking for augmented reality media , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[52]  Ronald Azuma,et al.  Tracking in unprepared environments for augmented reality systems , 1999, Comput. Graph..

[53]  Hirokazu Kato,et al.  Collaborative Mixed Reality , 1999 .

[54]  Blair MacIntyre,et al.  Adapting to dynamic registration errors using level of error (LOE) filtering , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[55]  Ronald Azuma,et al.  Hybrid inertial and vision tracking for augmented reality registration , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[56]  Jun Rekimoto,et al.  NaviCam:A Magnifying Glass Approach to Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[57]  Steven K. Feiner,et al.  Information filtering for mobile augmented reality , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[58]  Shigeru Nakamura,et al.  A Wearable Attitude-Measurement System Using a Fiberoptic Gyroscope , 2002, Presence: Teleoperators & Virtual Environments.

[59]  Henry Fuchs,et al.  Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization , 2000, Presence: Teleoperators & Virtual Environments.

[60]  Erik Viirre,et al.  The Virtual Retinal Display: A new Display Technology using Scanned Laser Light , 1998 .

[61]  Bruce H. Thomas,et al.  Integrating virtual and augmented realities in an outdoor application , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[62]  Tsuneo Yoshikawa,et al.  Accurate image overlay on video see-through HMDs using vision and accelerometers , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[63]  Yakup Genc,et al.  Augmented workspace: designing an AR testbed , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[64]  Simon J. Julier,et al.  Authoring of physical models using mobile computers , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[65]  Takeo Kanade,et al.  Virtual ized reality: constructing time-varying virtual worlds from real world events , 1997 .

[66]  Ulrich Neumann,et al.  Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[67]  Bernard D. Adelstein,et al.  Factors influencing operator interaction with virtual objects viewed via head-mounted see-through displays: viewing conditions and rendering latency , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[68]  Suya You,et al.  Natural Feature Tracking for Augmented Reality , 1999, IEEE Trans. Multim..

[69]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[70]  Paul Milgram,et al.  Perceptual issues in augmented reality , 1996, Electronic Imaging.

[71]  Steve Mann,et al.  Wearable Computing: A First Step Toward Personal Imaging , 1997, Computer.

[72]  Nassir Navab,et al.  Merging visible and invisible: two Camera-Augmented Mobile C-arm (CAMC) applications , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[73]  Leonard McMillan,et al.  Post-rendering 3D warping , 1997, SI3D.

[74]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[75]  Richard L. Holloway,et al.  Registration Error Analysis for Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[76]  Ron Frederick,et al.  Audio aura: light-weight audio augmented reality , 1997, UIST '97.

[77]  Jun Rekimoto,et al.  Augment-able reality: situated communication through physical and digital spaces , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[78]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[79]  Adam L. Janin,et al.  Several devils in the details: making an AR application work in the airplane factory , 1999 .

[80]  Makoto Sato,et al.  4 + 4 Fingers Manipulating Virtual Objects in Mixed-Reality Environment , 2002, Presence: Teleoperators & Virtual Environments.

[81]  Hiroyuki Ohno,et al.  An optical see-through display for mutual occlusion of real and virtual environments , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[82]  Yongduek Seo,et al.  Weakly calibrated video-based augmented reality: embedding and rendering through virtual camera , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[83]  W. Brent Seales,et al.  Multi-projector displays using camera-based registration , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[84]  Greg Welch,et al.  High-Performance Wide-Area Optical Tracking: The HiBall Tracking System , 2001, Presence: Teleoperators & Virtual Environments.

[85]  Greg Welch,et al.  SCAAT: incremental tracking with incomplete information , 1997, SIGGRAPH.

[86]  Jennifer Healey,et al.  Augmented Reality through Wearable Computing , 1997, Presence: Teleoperators & Virtual Environments.

[87]  Hideyuki Tamura,et al.  AR/sup 2/Hockey: a case study of collaborative augmented reality , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[88]  Jannick P. Rolland,et al.  A Survey of Tracking Technologies for Virtual Environments , 2001 .

[89]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.

[90]  Ulrich Neumann,et al.  A multi-ring fiducial system and an intensity-invariant detection method for scalable augmented reality , 1999 .

[91]  Hiroaki Ueda,et al.  A forgettable near eye display , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[92]  Steven K. Feiner,et al.  Enveloping users and computers in a collaborative 3D augmented reality , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[93]  Alex Pentland,et al.  Stochasticks: augmenting the billiards experience with probabilistic vision and wearable computers , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[94]  Yasuhiro Mukaigawa,et al.  Photometric image-based rendering for virtual lighting image synthesis , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[95]  Frank Biocca,et al.  Virtual Eyes Can Rearrange Your Body: Adaptation to Visual Displacement in See-Through, Head-Mounted Displays , 1998, Presence.

[96]  Marius S. Vassiliou,et al.  A wearable augmented reality testbed for navigation and control, built solely with commercial-off-the-shelf (COTS) hardware , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).