Tiles: A Mixed Reality Authoring Interface

Mixed Reality (MR) aims to create user interfaces where interactive virtual objects are overlaid on the physical environment, naturally blending with it in real time. In this paper we presents Tiles, a MR authoring interface for easy and effective spatial composition, layout and arrangement of digital objects in mixed reality environments. Based on a tangible MR interface approach, Tiles is a transparent user interface that allows users to seamlessly interact with both virtual and physical objects. It also introduces a consistent MR interface model, providing a set of tools that allow users to dynamically add, remove, copy, duplicate and annotate virtual objects anywhere in the 3D physical workspace. Although our interaction techniques are broadly applicable, we ground them in an application for rapid prototyping and evaluation of aircraft instrument panels. We also present informal user observations and a preliminary framework for further work.

[1]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[2]  Hideyuki Tamura,et al.  Welbo: an embodied conversational agent living in mixed reality space , 2000, CHI Extended Abstracts.

[3]  Hirokazu Kato,et al.  Marker Tracking and HMD Calibration for a Video - based AR Conferenc - ing System , 1999 .

[4]  Jun Rekimoto,et al.  Augment-able reality: situated communication through physical and digital spaces , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[5]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[6]  J. Michael Moshell,et al.  A Two-Handed Interface for Object Manipulation in Virtual Environments , 1995, Presence: Teleoperators & Virtual Environments.

[7]  Steven K. Feiner,et al.  Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system , 1999, Comput. Graph..

[8]  Jun Rekimoto,et al.  Matrix: a realtime object identification and registration method for augmented reality , 1998, Proceedings. 3rd Asia Pacific Computer Human Interaction (Cat. No.98EX110).

[9]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[10]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[11]  Jun Rekimoto,et al.  Augmented surfaces: a spatially continuous work space for hybrid computing environments , 1999, CHI '99.

[12]  Dieter Schmalstieg,et al.  Bridging multiple user interface dimensions with augmented reality , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[13]  Fumio Kishino,et al.  Augmented reality: a class of displays on the reality-virtuality continuum , 1995, Other Conferences.

[14]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[15]  Ivan Poupyrev,et al.  Augmented Groove: Collaborative Jamming in Augmented Reality , 2000, SIGGRAPH 2000.

[16]  Hiroshi Ishii,et al.  Iterative design of seamless collaboration media , 1994, CACM.

[17]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[18]  Hiroshi Ishii,et al.  The metaDESK: models and prototypes for tangible user interfaces , 1997, UIST '97.

[19]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[20]  Katashi Nagao,et al.  The world through the computer: computer augmented interaction with real world environments , 1995, UIST '95.

[21]  George W. Fitzmaurice,et al.  Situated information spaces and spatially aware palmtop computers , 1993, CACM.

[22]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[23]  Morten Fjeld,et al.  Exploring Brick-Based Navigation and Composition in an Augmented Reality , 1999, HUC.

[24]  Hiroshi Ishii,et al.  mediaBlocks: physical containers, transports, and controls for online media , 1998, SIGGRAPH.

[25]  Marc Olano,et al.  3DM: a three dimensional modeler using a head-mounted display , 1992, I3D '92.