Haptic Perception of Material Properties and Implications for Applications

Perceiving the material properties of objects through touch is generally superior to the perception of shape. We review major material properties accessible through haptic interaction, along with theoretical accounts of the underlying perceptual processes. These include roughness, friction, compliance, and thermal properties. Subsequently, we describe algorithms that have been used to render these same material properties on haptic devices. We then point to applications that have capitalized on the accessibility of material through touch, including tactile displays, simulation of mechanical mechanisms in the automobile, and medical training simulators.

[1]  R. Klatzky,et al.  Relative availability of surface and object properties during early haptic processing. , 1997, Journal of experimental psychology. Human perception and performance.

[2]  Mandayam A. Srinivasan,et al.  Surface Microgeometry: Tactile Perception and Neural Encoding , 1991 .

[3]  Rajesh Aggarwal,et al.  Recent Advancements in Medical Simulation: Patient-Specific Virtual Reality Simulation , 2012, World Journal of Surgery.

[4]  Frederick P. Brooks,et al.  Feeling and seeing: issues in force display , 1990, I3D '90.

[5]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[6]  M A Srinivasan,et al.  A meshless numerical technique for physically based real time medical simulations. , 2001, Studies in health technology and informatics.

[7]  Cagatay Basdogan,et al.  Virtual environments for medical training: graphical and haptic simulation of laparoscopic common bile duct exploration , 2001 .

[8]  Paul J. Stewart,et al.  A haptic hybrid controller for virtual prototyping of vehicle mechanisms , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[9]  Helen Petrie,et al.  Roughness perception in haptic virtual reality for sighted and blind people , 2007, Perception & psychophysics.

[10]  Hiromi Mochiyama,et al.  Fixed-step friction simulation: from classical Coulomb model to modern continuous models , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Lynette A. Jones,et al.  Warm or Cool, Large or Small? The Challenge of Thermal Displays , 2008, IEEE Transactions on Haptics.

[12]  Christian Laugier,et al.  Fast dynamic simulation of rigid and deformable objects , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[13]  Astrid M. L. Kappers,et al.  Cues for Haptic Perception of Compliance , 2009, IEEE Transactions on Haptics.

[14]  Joseph M. Romano,et al.  Creating Realistic Virtual Textures from Contact Acceleration Data , 2012, IEEE Transactions on Haptics.

[15]  Cagatay Basdogan,et al.  A Ray-Based Haptic Rendering Technique for Displaying Shape and Texture of 3D Objects in Virtual Environments , 1997, Dynamic Systems and Control.

[16]  Stephen A. Brewster,et al.  Creating Usable Pin Array Tactons for Nonvisual Information , 2009, IEEE Transactions on Haptics.

[17]  Kenneth O. Johnson,et al.  Neural Coding Mechanisms in Tactile Pattern Recognition: The Relative Contributions of Slowly and Rapidly Adapting Mechanoreceptors to Perceived Roughness , 1997, The Journal of Neuroscience.

[18]  M. Hollins,et al.  Pacinian representations of fine surface texture , 2005, Perception & psychophysics.

[19]  L.A. Jones,et al.  Material identification using real and simulated thermal cues , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Dean Karnopp,et al.  Computer simulation of stick-slip friction in mechanical dynamic systems , 1985 .

[21]  Antonio Frisoli,et al.  Haptic simulation of an automotive manual gearshift , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[22]  Roger D Adams,et al.  Manual discrimination capability when only viscosity is varied in viscoelastic stiffness stimuli. , 2003, Journal of manipulative and physiological therapeutics.

[23]  Vincent Hayward,et al.  The Spatial Spectrum of Tangential Skin Displacement Can Encode Tactual Texture , 2011, IEEE Transactions on Robotics.

[24]  Ole Vilhelm Larsen,et al.  Using Region-of-Interest Based Finite Element Modeling for Brain-Surgery Simulation , 1998, MICCAI.

[25]  W. B. Tiest Tactual perception of material properties , 2010, Vision Research.

[26]  S Weinstein,et al.  Intensive and extensive aspects of tactile sensitivity as a function of body part, sex, and laterality , 1968 .

[27]  M. Srinivasan,et al.  Tactual discrimination of softness. , 1995, Journal of neurophysiology.

[28]  John F. Hughes,et al.  Direct manipulation of free-form deformations , 1992, SIGGRAPH.

[29]  P. Dahl A Solid Friction Model , 1968 .

[30]  James C Craig,et al.  Perceptual Constancy of Texture Roughness in the Tactile System , 2011, The Journal of Neuroscience.

[31]  Antonio Bicchi,et al.  Haptic discrimination of softness in teleoperation: the role of the contact area spread rate , 2000, IEEE Trans. Robotics Autom..

[32]  Hsin-Ni Ho,et al.  Contribution of thermal cues to material discrimination and localization , 2006, Perception & psychophysics.

[33]  Dianne T. V. Pawluk,et al.  Using multiple contacts with texture-enhanced graphics , 2011, 2011 IEEE World Haptics Conference.

[34]  I. Hunter,et al.  A perceptual analysis of stiffness , 2004, Experimental Brain Research.

[35]  Carlos Canudas de Wit,et al.  A new model for control of systems with friction , 1995, IEEE Trans. Autom. Control..

[36]  Frank Tendick,et al.  Multirate simulation for high fidelity haptic interaction with deformable objects in virtual environments , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[37]  Myrthe A. Plaisier,et al.  Salient features in 3-D haptic shape perception , 2009, Attention, perception & psychophysics.

[38]  Brian J. Briscoe,et al.  Friction and lubrication of human skin , 2007 .

[39]  Morten Bro-Nielsen,et al.  Surgery Simulation Using fast Finite Elements , 1996, VBC.

[40]  T. Soneda,et al.  Investigation of vibrotactile sensation of human fingerpads by observation of contact zones , 2010 .

[41]  I. Hunter,et al.  A perceptual analysis of viscosity , 2004, Experimental Brain Research.

[42]  Susan J. Lederman,et al.  Perceiving Object Properties through a Rigid Link , 2008 .

[43]  Zygmunt Pizlo,et al.  Thresholds for Dynamic Changes in a Rotary Switch , 2003 .

[44]  Jochen Lang,et al.  IIR Filter Models of Haptic Vibration Textures , 2011, IEEE Transactions on Instrumentation and Measurement.

[45]  A. Kappers,et al.  Tactile perception of thermal diffusivity , 2009, Attention, perception & psychophysics.

[46]  Heiner Bubb,et al.  Mechatronic tools in haptic research for automotive applications , 2005 .

[47]  Karon E. MacLean,et al.  Designing Large Sets of Haptic Icons with Rhythm , 2008, EuroHaptics.

[48]  Marina Yiasemidou,et al.  Faster simulated laparoscopic cholecystectomy with haptic feedback technology , 2011 .

[49]  Herve Delingette,et al.  Real-Time Elastic Deformations of Soft Tissues for Surgery Simulation , 1999, IEEE Trans. Vis. Comput. Graph..

[50]  Jean-Claude Latombe,et al.  Algorithmic tools for real-time microsurgery simulation , 2002, Medical Image Anal..

[51]  John F. Canny,et al.  Haptic interaction with global deformations , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[52]  R. Klatzky,et al.  Feeling textures through a probe: Effects of probe and surface geometry and exploratory factors , 2003, Perception & psychophysics.

[53]  C. Coulomb Théorie des machines simples, en ayant égard au frottement de leurs parties et a la roideur des cordages , 1968 .

[54]  Heiner Bubb,et al.  Haptical feeling of rotary switches , 2006 .

[55]  Vincent Hayward,et al.  Tactile Graphics Rendering Using Three Laterotactile Drawing Primitives , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[56]  J. Craig,et al.  Grating orientation as a measure of tactile spatial acuity. , 1999, Somatosensory & motor research.

[57]  Frank Tendick,et al.  Adaptive Nonlinear Finite Elements for Deformable Body Simulation Using Dynamic Progressive Meshes , 2001, Comput. Graph. Forum.

[58]  Roberta L. Klatzky,et al.  Roughness Perception in Virtual Textures , 2011, IEEE Transactions on Haptics.

[59]  Ming C. Lin,et al.  Haptic display of interaction between textured models , 2004, IEEE Visualization 2004.

[60]  Blake Hannaford,et al.  Manipulation in real, virtual and remote environments , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[61]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[62]  R. Klatzky,et al.  Haptic perception: A tutorial , 2009, Attention, perception & psychophysics.

[63]  Mircea Badescu,et al.  Rotary haptic knob for vehicular instrument controls , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[64]  Astrid M. L. Kappers,et al.  Kinaesthetic and Cutaneous Contributions to the Perception of Compressibility , 2008, EuroHaptics.

[65]  M. Hollins,et al.  Vibrotactile intensity and frequency information in the Pacinian system: A psychophysical model , 2005, Perception & psychophysics.

[66]  J. Edward Colgate,et al.  The haptic profile: capturing the feel of switches , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[67]  Martin Buss,et al.  Development and Evaluation of a Device for the Haptic Rendering of Rotatory Car Doors , 2011, IEEE Transactions on Industrial Electronics.

[68]  S J Bolanowski,et al.  Effects of hydration on tactile sensation. , 1998, Somatosensory & motor research.

[69]  Norberto F. Ezquerra,et al.  Interactively deformable models for surgery simulation , 1993, IEEE Computer Graphics and Applications.

[70]  S. Derler,et al.  Tribology of Skin: Review and Analysis of Experimental Results for the Friction Coefficient of Human Skin , 2011, Tribology Letters.

[71]  Karon E. MacLean,et al.  Perceptual Design of Haptic Icons , 2003 .

[72]  C. Christensen,et al.  Oral and Nonoral Perception of Solution Viscosity , 1987 .

[73]  Won-Sook Lee,et al.  Modelling of haptic vibration textures with infinite-impulse-response filters , 2009, 2009 IEEE International Workshop on Haptic Audio visual Environments and Games.

[74]  R H LaMotte,et al.  Softness discrimination with a tool. , 2000, Journal of neurophysiology.

[75]  M A Srinivasan,et al.  Manual discrimination of compliance using active pinch grasp: The roles of force and work cues , 1995, Perception & psychophysics.

[76]  Cagatay Basdogan,et al.  Efficient Point-Based Rendering Techniques for Haptic Display of Virtual Objects , 1999, Presence.

[77]  Michael A. Peshkin,et al.  Restoring physicality to touch interaction with programmable friction , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[78]  D. D. Quinn A New Regularization of Coulomb Friction , 2002 .

[79]  Joseph M. Romano,et al.  Haptography: Capturing and Recreating the Rich Feel of Real Surfaces , 2009, ISRR.

[80]  O. Reynolds I. On the theory of lubrication and its application to Mr. Beauchamp tower’s experiments, including an experimental determination of the viscosity of olive oil , 1886, Proceedings of the Royal Society of London.

[81]  K O Johnson,et al.  Tactile spatial resolution. I. Two-point discrimination, gap detection, grating resolution, and letter recognition. , 1981, Journal of neurophysiology.

[82]  Dinesh K. Pai,et al.  Multiresolution green's function methods for interactive simulation of large-scale elastostatic objects , 2003, TOGS.

[83]  Allison M. Okamura,et al.  Vibration feedback models for virtual environments , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[84]  Vincent Hayward,et al.  Multirate haptic simulation achieved by coupling finite element meshes through Norton equivalents , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[85]  Antonio Bicchi,et al.  The role of contact area spread rate in haptic discrimination of softness , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[86]  U. Kühnapfel,et al.  Animation and Simulation Techniques for VR-Training Systems in Endoscopic Surgery , 2000, Computer Animation and Simulation.

[87]  Vincent Hayward,et al.  Compact, Portable, Modular, High-performance, Distributed Tactile Transducer Device Based on Lateral Skin Deformation , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[88]  B. Allotta,et al.  A mechatronic device for simulating push-buttons and knobs , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[89]  C. Cao,et al.  Effect of haptic feedback in laparoscopic surgery skill acquisition , 2012, Surgical Endoscopy.

[90]  John M. Hollerbach,et al.  Haptic Models of an Automotive Turn-Signal Switch: Identification and Playback Results , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[91]  S. E. Salcudean,et al.  On the Emulation of Stiff Walls and Static Friction with a Magnetically Levitated Input/Output Devic , 1997 .

[92]  U. Ku,et al.  Endoscopic surgery training using virtual reality and deformable tissue simulation , 2000 .

[93]  Marc Arthur Masen,et al.  An experimental study on the relation between surface texture and tactile friction , 2012 .

[94]  S Lakatos,et al.  Haptic form perception: Relative salience of local and global features , 1999, Perception & psychophysics.

[95]  C Basdogan,et al.  Force interactions in laparoscopic simulations: haptic rendering of soft tissues. , 1998, Studies in health technology and informatics.

[96]  Ming C. Lin,et al.  A perceptually-inspired force model for haptic texture rendering , 2004, APGV '04.

[97]  Karon E. MacLean,et al.  Haptic phonemes: basic building blocks of haptic communication , 2006, ICMI '06.

[98]  Susan J. Lederman,et al.  Haptic integration of object properties: texture, hardness, and planar contour. , 1989 .

[99]  J. Boughman,et al.  The World of AJHG , 2007 .

[100]  John Cohen The World of Touch , 1952, Nature.

[101]  Stephen A. Brewster,et al.  New parameters for tacton design , 2007, CHI Extended Abstracts.

[102]  A. M. Smith,et al.  Subjective scaling of smooth surface friction. , 1996, Journal of neurophysiology.

[103]  Christoph Doerrer,et al.  Simulating push-buttons using a haptic display : requirements on force resolution and force-displacement curve , 2001 .

[104]  R. Klatzky,et al.  There's more to touch than meets the eye: The salience of object attributes for haptics with and without vision. , 1987 .

[105]  Vincent Hayward,et al.  Single state elastoplastic friction models , 2002, IEEE Trans. Autom. Control..

[106]  Dianne T. V. Pawluk,et al.  Roughness perception of textures on a haptic matrix display , 2011, 2011 IEEE World Haptics Conference.

[107]  William Harwin,et al.  Effects of Physical Bandwidth on Perception of Virtual Gratings , 2000, Dynamic Systems and Control: Volume 2.

[108]  Carlos Canudas de Wit,et al.  A survey of models, analysis tools and compensation methods for the control of machines with friction , 1994, Autom..

[109]  P. Dupont,et al.  Single State Elasto-Plastic Friction Models , 2002 .

[110]  Morten Bro-Nielsen,et al.  Real‐time Volumetric Deformable Models for Surgery Simulation using Finite Elements and Condensation , 1996, Comput. Graph. Forum.

[111]  Matteo Bianchi,et al.  Rendering Softness: Integration of Kinesthetic and Cutaneous Information in a Haptic Device , 2010, IEEE Transactions on Haptics.

[112]  John Kenneth Salisbury,et al.  Haptic rendering: programming touch interaction with virtual objects , 1995, I3D '95.

[113]  BENJAMIN WHITE,et al.  Vision Substitution by Tactile Image Projection , 1969, Nature.

[114]  J. Williams,et al.  Haptic chameleon: a new concept of shape-changing user interface controls with force feedback , 2004, CHI EA '04.

[115]  R. Klatzky,et al.  Haptic integration of object properties: texture, hardness, and planar contour. , 1989, Journal of experimental psychology. Human perception and performance.

[116]  Lucian Panait,et al.  The role of haptic feedback in laparoscopic simulation training. , 2009, The Journal of surgical research.

[117]  M. Cutkosky,et al.  Roughness Perception of Haptically Displayed Fractal Surfaces , 2000, Dynamic Systems and Control: Volume 2.

[118]  Kenneth O. Johnson,et al.  Review: Neural Coding and the Basic Law of Psychophysics , 2002, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[119]  Susan J. Lederman,et al.  Perceiving Texture through a Probe , 2002 .

[120]  Dinesh K. Pai,et al.  Haptic texturing-a stochastic approach , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[121]  Lorna M. Brown,et al.  A first investigation into the effectiveness of Tactons , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[122]  Nigel W. John,et al.  The Role of Haptics in Medical Training Simulators: A Survey of the State of the Art , 2011, IEEE Transactions on Haptics.

[123]  Peter Niederer,et al.  Virtual Reality-Based Simulation of Endoscopic Surgery , 2000, Presence: Teleoperators & Virtual Environments.

[124]  S. Lederman Tactile roughness of grooved surfaces: The touching process and effects of macro- and microsurface structure , 1974 .

[125]  Oussama Khatib,et al.  The haptic display of complex graphical environments , 1997, SIGGRAPH.

[126]  Dinesh K. Pai,et al.  ArtDefo: accurate real time deformable objects , 1999, SIGGRAPH.

[127]  Astrid M. L. Kappers,et al.  Haptic Discrimination and Matching of Viscosity , 2013, IEEE Transactions on Haptics.