Introduction to Haptics

Haptics refers to the modality of touch and associated sensory feedback. Researchers working in the area are concerned with the development , testing, and refinement of tactile and force feedback devices and supporting software that permit users to sense (" feel ") and manipulate three-dimensional virtual objects with respect to such features as shape, weight, surface textures, and temperature. In addition to basic psychophysical research on human haptics, and issues in machine haptics such as collision detection, force feedback, and haptic data compression, work is being done in application areas such as surgical simulation, medical training, scientific visualization, and assistive technology for the blind and visually impaired. How can a device emulate the sense of touch? Let us consider one of the devices from SensAble Technologies. The 3 DOF (degrees-of-freedom) PHANToM is a small robot arm with three revolute joints, each connected to a computer-controlled electric DC motor. The tip of the device is attached to a stylus that is held by the user. By sending appropriate volt-2 Introduction to Haptics Chapter 1 ages to the motors, it is possible to exert up to 1.5 pounds of force at the tip of the stylus, in any direction. The basic principle behind haptic rendering is simple: Every millisecond or so, the computer that controls the PHANToM reads the joint encoders to determine the precise position of the stylus. It then compares this position to those of the virtual objects the user is trying to touch. If the user is away from all the virtual objects, a zero voltage is sent to the motors and the user is free to move the stylus (as if exploring empty space). However, if the system detects a collision between the stylus and one of the virtual objects, it drives the motors so as to exert on the user's hand (through the stylus) a force along the exterior normal to the surface being penetrated. In practice, the user is prevented from penetrating the virtual object just as if the stylus collided with a real object that transmits a reaction to the user's hand. Different haptic devices—such as Immersion Corporation's CyberGrasp—operate under the same principle but with different mechanical actuation systems for force generation. Although the basic principles behind haptics are simple, there are significant technical challenges, such as the construction of the physical devices (cf. Chapter 4), real-time collision detection (cf. Chapters 2 and 5), simulation …

[1]  Gaurav S. Sukhatme,et al.  Touch in Immersive Environments , 2000 .

[2]  Mandayam A. Srinivasan,et al.  Visually impaired person's use of the PHANToM for information about texture and 3D form of virtual objects. , 1998 .

[3]  Qian Chen,et al.  Image synthesis from a sparse set of views , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[4]  T P Way,et al.  Automatic visual to tactile translation--Part I: Human factors, access methods, and image manipulation. , 1997, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[5]  Kevin Cleary,et al.  Closed-Loop Force Control for Haptic Simulation of Virtual Environments , 2000 .

[6]  Gérard G. Medioni,et al.  A semi-automatic system to infer complex 3-D shapes from photographs , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[7]  Gregory D. Hager,et al.  Robot hand-eye coordination based on stereo vision , 1995 .

[8]  Martin Held,et al.  Evaluation of Collision Detection Methods for Virtual Reality Fly-Throughs , 1995 .

[9]  Blake Hannaford,et al.  Force Feedback in Shared Virtual Simulations , 1996 .

[10]  Lisa J. K. Durbeck,et al.  SCIRun Haptic Display for Scientific Visualization , 1999 .

[11]  Blake Hannaford,et al.  Stable Control of Haptics , 2001 .

[12]  A. Morse.  Supervisory control of families of linear set-point controllers Part I. Exact matching , 1996, IEEE Trans. Autom. Control..

[13]  Gaurav S. Sukhatme,et al.  Haptic Collaboration over the Internet , 2000 .

[14]  Gunnar Jansson,et al.  Can a haptic force feedback display provide visually impaired people with useful information about texture roughness and 3D form of virtual objects , 1998 .

[15]  John Kenneth Salisbury,et al.  Haptic rendering: programming touch interaction with virtual objects , 1995, I3D '95.

[16]  A. Morse.  Supervisory control of families of linear set-point controllers , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[17]  Edsger W. Dijkstra,et al.  Solution of a problem in concurrent programming control , 1965, CACM.

[18]  Scott S. Snibbe,et al.  Springs and Constraints for 3D Drawing , 1998 .

[19]  Cagatay Basdogan,et al.  Haptics in virtual environments: taxonomy, research status, and challenges , 1997, Comput. Graph..

[20]  Dinesh K. Pai,et al.  Haptic interaction with multiresolution image curves , 1997, Comput. Graph..

[21]  Ming C. Lin,et al.  Collision Detection between Geometric Models: A Survey , 1998 .

[22]  Lingling Zhang,et al.  Alternative techniques for the efficient acquisition of haptic data , 2001, SIGMETRICS '01.

[23]  S. Ballesteros,et al.  Haptic discrimination of bilateral symmetry in 2-dimensional and 3-dimensional unfamiliar displays , 1997, Perception & psychophysics.

[24]  Y. Ikei,et al.  Texture presentation by vibratory tactile display-image based presentation of a tactile texture , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[25]  Hiroo Iwata,et al.  LHX: an integrated software tool for haptic interface , 1997, Comput. Graph..

[26]  Cagatay Basdogan,et al.  The role of Haptic communication in shared virtual environments , 1998 .

[27]  Robert D. Howe,et al.  Tactile sensing and control of robotic manipulation , 1993, Adv. Robotics.

[28]  Cyrus Shahabi,et al.  Analysis of haptic data for sign language recognition , 2001, HCI.

[29]  S. Shankar Sastry,et al.  Telesurgery and surgical simulation: design, modeling, and evaluation of haptic interfaces to real and virtual surgical environments , 2000 .

[30]  Qian Chen,et al.  Building human face models from two images , 1998, 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175).

[31]  M. Heller.  Visual and tactual texture perception: Intersensory cooperation , 1982, Perception & psychophysics.

[32]  Mel Slater,et al.  Presence in Shared Virtual Environments and Virtual Togetherness , 2000, Presence: Teleoperators & Virtual Environments.

[33]  Gunnar Jansson,et al.  The PHANToM used without visual guidance. , 1999 .

[34]  Thomas S. Brinsmead,et al.  Multiple model adaptive control. Part 2: switching , 2001 .

[35]  Cagatay Basdogan,et al.  An Experiment on the Influence of Haptic Communication on the Sense of Being Together , 1998 .

[36]  Calle Sjöström.  The Phantasticon: The PHANToM for disabled children , 1996 .

[37]  R. Klatzky,et al.  There's more to touch than meets the eye: The salience of object attributes for haptics with and without vision. , 1987 .

[38]  Grigore C. Burdea,et al.  Human performance using virtual reality tumor palpation simulation , 1997, Comput. Graph..

[39]  Stephen A. Brewster,et al.  Constructing sonified haptic line graphs for the blind student: first steps , 2000, Assets '00.

[40]  T. Anderson.  A virtual universe utilizing haptic display , 1996 .

[41]  Susan J. Lederman,et al.  Tactual roughness perception in human: a psychophysical assessment of the role of vibration , 1985 .

[42]  Stephen A. Brewster,et al.  Haptic Graphs for Blind Computer Users , 2000, Haptic Human-Computer Interaction.

[43]  Yvette Hatwell,et al.  Children's memory for location and object properties in vision and haptics: automatic or attentional processing? , 1995 .

[44]  Nicole B. Ellison,et al.  Measuring Internet Audiences: Patrons of an on-Line Art Museum , 1999 .

[45]  J. Edward Colgate,et al.  Physics-based approach to haptic display , 1994 .

[46]  Blake Hannaford,et al.  Architectures for shared haptic virtual environments , 1997, Comput. Graph..

[47]  J. Edward Colgate,et al.  Passivity of a class of sampled-data systems: Application to haptic interfaces , 1997, J. Field Robotics.

[48]  Kirsten Rassmus-Gröhn,et al.  Using a force feedback device to present graphical information to people with visual disabilities , 1998 .

[49]  James M. Van Verth,et al.  Adding force feedback to graphics systems: issues and solutions , 1996, SIGGRAPH.

[50]  Ed Colgate,et al.  Stability of discrete time systems with unilateral nonlinearities , 1995 .

[51]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[52]  Randy A. Freeman,et al.  Passive implementation for a class of static nonlinear environments in haptic display , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[53]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[54]  A.J. Johansson,et al.  Using simple force feedback mechanisms as haptic visualization tools , 1999, IMTC/99. Proceedings of the 16th IEEE Instrumentation and Measurement Technology Conference (Cat. No.99CH36309).

[55]  Leslie Lamport,et al.  Concurrent reading and writing , 1977, Commun. ACM.

[56]  Blake Hannaford,et al.  Stable haptic interaction with virtual environments , 1999, IEEE Trans. Robotics Autom..

[57]  J. Edward Colgate,et al.  Factors affecting the Z-Width of a haptic display , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[58]  Susan J. Lederman,et al.  Perceiving Texture through a Probe , 2002 .

[59]  Yvette Hatwell,et al.  Dimensional and overall similarity classifications in haptics: A developmental study , 1993 .

[60]  R L Klatzky,et al.  Length distortion of temporally extended visual displays: Similarity to haptic spatial perception , 1989, Perception & psychophysics.

[61]  R. Balaniuk,et al.  LEM-An approach for physically based soft tissue simulation suitable for haptic interaction , .

[62]  R. Howe,et al.  Identification of the mechanical impedance at the human finger tip. , 1997, Journal of biomechanical engineering.

[63]  Cagatay Basdogan,et al.  A Ray-Based Haptic Rendering Technique for Displaying Shape and Texture of 3D Objects in Virtual Environments , 1997, Dynamic Systems and Control.

[64]  Marcelo Knörich Zuffo,et al.  Fuzzy Rule-Based Evaluation for a Haptic and Stereo Simulator for Bone Marrow Harvest for Transplant , 2000 .

[65]  Greg R. Luecke,et al.  Contact sensation in the synthetic environment using the ISU force reflecting exoskeleton , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[66]  Blake Hannaford,et al.  Detection thresholds for small haptic effects , 2002, SPIE Optics East.

[67]  Mark Holliins,et al.  Perceptual dimensions of tactile surface texture: A multidimensional scaling analysis , 1993, Perception & psychophysics.

[68]  Andrew B. Mor.  5 DOF Force Feedback Using the 3 DOF Phantom and a 2 DOF Device , 1998 .

[69]  Gaurav S. Sukhatme,et al.  The Haptic Museum , 2000 .

[70]  Cyrus Shahabi,et al.  Analysis of clustering techniques to detect hand signs , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[71]  Yvette Hatwell,et al.  Development of dimensional vs. global processing in haptics: The perceptual and decisional determinants of classification skills , 1995 .

[72]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[73]  Blake Hannaford,et al.  Force Feedback in Virtual and Shared Environments , 1995 .

[74]  Thomas Massie.  A Tangible Goal for 3D Modeling , 1998, IEEE Computer Graphics and Applications.

[75]  M. A. Srinivassan.  The impact of visual information on the haptic perception of stiffness in virtual environments , 1996 .

[76]  Daniel H. Gomez.  A dextrous hand master with force feedback for virtual reality , 1998 .

[77]  J. Edward Colgate,et al.  Implementation of stiff virtual walls in force-reflecting interfaces , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[78]  Neville Hogan,et al.  Controlling impedance at the man/machine interface , 1989, Proceedings, 1989 International Conference on Robotics and Automation.