AR-Jig: A Handheld Tangible User Interface for Modification of 3D Digital Form via 2D Physical Curve

We introduce AR-Jig, a new handheld tangible user interface for 3D digital modeling in augmented reality (AR) space. AR-Jig has a pin array that displays a 2D physical curve coincident with a contour of a digitally displayed 3D form. It supports physical interaction with a portion of a 3D digital representation, allowing 3D forms to be directly touched and modified. Traditional tangible user interfaces physically embody all the data; in contrast, this project leaves the majority of the data in the digital domain but gives physicality to any portion of the larger digital dataset via a handheld tool. This tangible intersection enables the flexible manipulation of digital artifacts, both physically and virtually. Through an informal test by end-users and interviews with professionals, we confirmed the potential of the AR-Jig concept while identifying the improvements necessary to make AR-Jig a practical tool for 3D digital design.

[1]  Hiroshi Ishii,et al.  Illuminating clay: a 3-D tangible interface for landscape analysis , 2002, CHI.

[2]  Hiroo Iwata,et al.  Project FEELEX: adding haptic surface to graphics , 2001, SIGGRAPH.

[3]  Jong Weon Lee,et al.  Tangible Augmented Reality Modeling , 2004, ICEC.

[4]  Christopher R. Wagner,et al.  A tactile shape display using RC servomotors , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[5]  William Buxton,et al.  Creating principal 3D curves with digital tape drawing , 2002, CHI.

[6]  Peter Schröder,et al.  Surface drawing: creating organic 3D shapes with the hand and tangible tools , 2001, CHI.

[7]  Umberto Cugini,et al.  Create free-form digital shapes with hands , 2005, GRAPHITE '05.

[8]  Hideyuki Tamura,et al.  MR Platform: a basic body on which mixed reality applications are built , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[9]  Ken Perlin,et al.  Physical objects as bidirectional user interface elements , 2004, IEEE Computer Graphics and Applications.

[10]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[11]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[12]  Yoshifumi Kitamura,et al.  Interactive retrieval of 3D shape models using physical objects , 2004, MULTIMEDIA '04.

[13]  Tovi Grossman,et al.  An interface for creating and manipulating curves using a high degree-of-freedom curve input device , 2003, CHI '03.

[14]  Raffaele de Amicis,et al.  Spacedesign: A Mixed Reality Workspace for Aesthetic Industrial Design , 2002, ISMAR.

[15]  Paul A. Beardsley,et al.  Tangible interaction + graphical interpretation: a new approach to 3D modeling , 2000, SIGGRAPH.

[16]  Naoki Kawakami,et al.  3D Form Display with Shape Memory Alloy , 2003, ICAT.

[17]  W. V. Glenn,et al.  THREE-DIMENSIONAL DISPLAY OF CT DATA , 1978 .

[18]  Masayoshi Esashi,et al.  Dynamic Braille display using SMA coil actuator and magnetic latch , 2005 .

[19]  D. Maynes-Aminzade,et al.  The actuated workbench: computer-controlled actuation in tabletop tangible interfaces , 2003, ACM Trans. Graph..

[20]  Matt Adcock,et al.  Haptic collaboration with augmented reality , 2004, SIGGRAPH '04.

[21]  Jun Rekimoto,et al.  Lumen: interactive visual and shape display for calm computing , 2004, SIGGRAPH '04.