Haptography: Capturing and Recreating the Rich Feel of Real Surfaces

Haptic interfaces, which allow a user to touch virtual and remote environments through a hand-held tool, have opened up exciting new possibilities for applications such as computer-aided design and robot-assisted surgery. Unfortunately, the haptic renderings produced by these systems seldom feel like authentic re-creations of the richly varied surfaces one encounters in the real world. We have thus envisioned the new approach of haptography, or haptic photography, in which an individual quickly records a physical interaction with a real surface and then recreates that experience for a user at a different time and/or place. This paper presents an overview of the goals and methods of haptography, emphasizing the importance of accurately capturing and recreating the high frequency accelerations that occur during tool-mediated interactions. In the capturing domain, we introduce a new texture modeling and synthesis method based on linear prediction applied to acceleration signals recorded from real tool interactions. For recreating, we show a new haptography handle prototype that enables the user of a Phantom Omni to feel fine surface features and textures.

[1]  Katherine J. Kuchenbecker,et al.  Haptic display of realistic tool contact via dynamically compensated control of a dedicated actuator , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  John Kenneth Salisbury,et al.  Haptic Rendering: Introductory Concepts , 2004, IEEE Computer Graphics and Applications.

[3]  Hyoukryeol Choi,et al.  Development of Soft-Actuator-Based Wearable Tactile Display , 2008, IEEE Transactions on Robotics.

[4]  Jacob Benesty,et al.  Springer handbook of speech processing , 2007, Springer Handbooks.

[5]  J. Bell,et al.  The structure and function of pacinian corpuscles: A review , 1994, Progress in Neurobiology.

[6]  K. E. MacLean,et al.  The “Haptic Camera”: A Technique for Characterizing and Playing Back Haptic Properties of Real Environments , 1996, Dynamic Systems and Control.

[7]  Cagatay Basdogan,et al.  A Ray-Based Haptic Rendering Technique for Displaying Shape and Texture of 3D Objects in Virtual Environments , 1997, Dynamic Systems and Control.

[8]  James Durbin,et al.  The fitting of time series models , 1960 .

[9]  Allison M. Okamura,et al.  Measurement-Based Modeling for Haptic Rendering , 2008 .

[10]  Katherine J. Kuchenbecker,et al.  Displaying realistic contact accelerations via a dedicated vibration actuator , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[11]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[12]  Dinesh K. Pai,et al.  ACME, A Telerobotic Active Measurement Facility , 1999, ISER.

[13]  Vincent Hayward,et al.  Fundamental limits in the rendering of virtual haptic textures , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[14]  Robert D. Howe,et al.  Tactile Display of High-Frequency Information in Teleoperation and Virtual Environments. , 1995 .

[15]  J. Murray,et al.  HANDBOOK OF PSYCHOLOGY , 1951 .

[16]  Takashi Yoshioka,et al.  Factors Involved in Tactile Texture Perception Through Probes , 2009, Adv. Robotics.

[17]  Katherine J. Kuchenbecker,et al.  Shaping Event-Based Haptic Transients Via an Improved Understanding of Real Contact Dynamics , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[18]  Katherine J. Kuchenbecker.  Haptography: capturing the feel of real objects to enable authentic haptic rendering (invited paper) , 2008, HAS '08.

[19]  Allison M. Okamura,et al.  Reality-based models for vibration feedback in virtual environments , 2001 .

[20]  Susan J. Lederman,et al.  Perceiving Object Properties through a Rigid Link , 2008 .

[21]  S. Lederman,et al.  TACTUAL PERCEPTION , 2003 .

[22]  Dinesh K. Pai,et al.  The WHaT: a wireless haptic texture sensor , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[23]  Robert D. Howe,et al.  Tactile Display of Vibratory Information in Teleoperation and Virtual Environments , 1995, Presence: Teleoperators & Virtual Environments.

[24]  L. H. Anauer,et al.  Speech Analysis and Synthesis by Linear Prediction of the Speech Wave , 2000 .

[25]  John M. Hollerbach,et al.  Identification of nonlinear passive devices for haptic simulations , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[26]  Vincent Hayward,et al.  A tactile enhancement instrument for minimally invasive surgery , 2005, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[27]  E. A. Flinn.  Comments on “Speech Analysis and Synthesis by Linear Prediction of the Speech Wave” [B. S. Atal and S. L. Hanauer, J. Acoust. Soc. Amer. 50, 637–655 (1971)] , 1972 .

[28]  William Harwin,et al.  A high bandwidth interface for haptic human computer interaction , 2001 .

[29]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[30]  Leon G. Higley,et al.  Forensic Entomology: An Introduction , 2009 .

[31]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[32]  Katherine J. Kuchenbecker,et al.  Improving contact realism through event-based haptic feedback , 2006, IEEE Transactions on Visualization and Computer Graphics.

[33]  Yu Sun,et al.  EigenNail for Finger Force Direction Recognition , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[34]  Jack M. Loomis,et al.  Distal Attribution and Presence , 1992, Presence: Teleoperators & Virtual Environments.