Coincident display using haptics and holographic video

In this paper, we describe the implementation of a novel system which enables a user to “carve” a simple free-standing electronic holographic image using a force-feedback device. The force-feedback (or haptic) device has a stylus which is held by the hand like an ordinary cutting tool. The 3D position of the stylus tip is reported by the device, and appropriate forces can be displayed to the hand as it interacts with 3D objects in the haptic workspace. The haptic workspace is spatially overlapped and registered with the holographic video display volume. Within the resulting coincident visuo-haptic workspace, a 3D synthetic cylinder is presented, spinning about its long axis, which a person can see, feel, and lathe with the stylus. This paper introduces the concept of coincident visuo-haptic display and describes the implementation of the lathe simulation. After situating the work in a research context, we present the details of system design and implementation, including the haptic and holographic modeling. Finally, we discuss the performance of this prototype system and future work.

[1]  John Stephen Underkoffler.  Toward accurate computation of optically reconstructed holograms , 1991 .

[2]  Pierre St. Hilaire.  Scalable Optical Architectures for Electronic Holography. , 1994 .

[3]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[4]  Michael Deering,et al.  High resolution virtual reality , 1992, SIGGRAPH.

[5]  Malcolm McCullough,et al.  Abstracting Craft: The Practiced Digital Hand , 1996 .

[6]  Michael A. Klug,et al.  Tangible holography: adding synthetic touch to 3D display , 1997, Electronic Imaging.

[7]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[8]  Wendy E. Mackay,et al.  Back to the real world , 1993, CACM.

[9]  Wendy E. Mackay,et al.  Computer-Augmented Environments: Back to the Real World - Introduction to the Special Issue. , 1993 .

[10]  Mark R. Jones.  Haptic hologram , 1995, Other Conferences.

[11]  Takeo Kanade,et al.  Vision-based visual/haptic registration for WYSIWYF display , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[12]  James M. Van Verth,et al.  Adding force feedback to graphics systems: issues and solutions , 1996, SIGGRAPH.

[13]  Benjie Chen,et al.  Generalized pipeline for preview and rendering of synthetic holograms , 1997, Electronic Imaging.

[14]  V. Michael Bove,et al.  Hardware architecture for rapid generation of electro-holographic fringe patterns , 1995, Electronic Imaging.