Perceptual Issues Improve Haptic Systems Performance

Since its introduction in the early 50's, teleoperation systems have expanded their reach, to address micro and macro manipulation, interaction with virtual worlds and the general field of haptic interaction. From its beginnings, as a mean to handle radioactive materials and to reduce human presence in dangerous areas, teleoperation and haptics have also become an interaction modality with computer generated objects and environments. One of the main goals of teleoperation is to achieve transparency, i.e. the complete perception by the human operator of the virtual or remote environment with which he/she is interacting (Lawrence, 1993). The ability of a teleoperation system to provide transparency depends upon the performance of the master and the slave, and of its control system. Ideally, the master should be able to emulate any environment, real or simulated, from freespace to infinitely stiff obstacles. The design of a transparent haptic interface is a quite challenging engineering task, since motion and sensing capabilities of the human hand/arm system are difficult to match. Furthermore, recent studies are providing more and more evidence that transparency is not only achieved by a good engineering design, but also by a combination of perceptual and cognitive factors that affect the operator ability to actually perceive the stimuli provided. The current knowledge on operator models reflects two separate groups of results. On one hand, there are guidelines for the design of an effective interface, from a human factors points of view, which include perceptual issues related to the cognitive and information processing of the human operators (see Subsection 2.4). On the other hand, there are several operator models related to biomechanical, bandwidth and reaction time issues (see Subsection 2.5). In this work we survey the main human factors that concur to the effectiveness of a haptic interface, and we present a series of psychophysical experiments, which can enrich performance in haptic systems, by measuring the mechanical effectiveness of the interface, providing a measure of the perception of a human operator. In addition the experiments are useful to represent the complex behavior of the human perception capabilities, and to propose new ways for enhancing the transparency of the virtual environment, by proposing suitable force scaling functions. In addition, our experience with psychophysics procedures highlights the needs of non-classical approaches to the problem, but the design of this type of experiments is not trivial, thus the need of a dedicated software tool or library arises. 22

[1]  K. B. Shimoga,et al.  Finger Force and Touch Feedback Issues in Dexterous Telemanipulation , 1992, Proceedings. Fourth Annual Conference on Intelligent Robotic Systems for Space Exploration.

[2]  Dale A. Lawrence Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[3]  Ezra S. Krendel,et al.  The human operator as a servo system element , 1959 .

[4]  Jörn Diedrichsen,et al.  Illusions of force perception: the role of sensori-motor predictions, visual information, and motor errors. , 2007, Journal of neurophysiology.

[5]  W. M. Rabinowitz,et al.  Manual discrimination and identification of length by the finger-span method , 1989, Perception & psychophysics.

[6]  Jonathan W. Peirce,et al.  PsychoPy—Psychophysics software in Python , 2007, Journal of Neuroscience Methods.

[7]  John Kenneth Salisbury,et al.  Haptic discrimination of force direction and the influence of visual information , 2006, TAP.

[8]  Blake Hannaford,et al.  A practical measure of dynamic response of haptic devices , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[9]  Allison M. Okamura,et al.  Vibration feedback models for virtual environments , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[10]  L. A. Jones Matching Forces: Constant Errors and Differential Thresholds , 1989, Perception.

[11]  Kevin M. Corker Human performance simulation in the analysis of advanced air traffic management , 1999, WSC '99.

[12]  S S Hsiao,et al.  Detection of vibration transmitted through an object grasped in the hand. , 1999, Journal of neurophysiology.

[13]  Myriam Levy,et al.  Haptic discrimination of two-dimensional angles: influence of exploratory strategy , 2006, Experimental Brain Research.

[14]  Roberta L. Klatzky,et al.  Measuring just noticeable differences for haptic force feedback: implications for rehabilitation , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[15]  Imad H. Elhajj,et al.  Human Perception of Haptic Force Direction , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  I. Hunter,et al.  A perceptual analysis of stiffness , 2004, Experimental Brain Research.

[17]  Norman H. Anderson,et al.  Empirical Direction in Design and Analysis , 2001 .

[18]  J. Edward Colgate,et al.  Implementation of stiff virtual walls in force-reflecting interfaces , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[19]  Paolo Fiorini,et al.  FPGA-based Controller for Haptic Devices , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Sara McMains,et al.  Evaluation of drawing on 3D surfaces with haptics , 2004, IEEE Computer Graphics and Applications.

[21]  K. Corker,et al.  Human performance simulation in the analysis of advanced air traffic management , 1999, WSC'99. 1999 Winter Simulation Conference Proceedings. 'Simulation - A Bridge to the Future' (Cat. No.99CH37038).

[22]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[23]  Robert D. Howe,et al.  Tactile Display of Vibratory Information in Teleoperation and Virtual Environments , 1995, Presence: Teleoperators & Virtual Environments.

[24]  Allison M. Okamura,et al.  Effects of velocity on human force control , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[25]  Marco Vicentini,et al.  Overshoot Effect in Stiffness Perception Tasks during Hand Motion with Haptic Device , 2008, EuroHaptics.

[26]  J. K. Salisbury,et al.  Kinesthetic coupling between operator and remote manipulator , 1980 .

[27]  Marco Vicentini,et al.  Signal manipulation based on perceptual thresholds enhances surface experience with common haptic device , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[28]  N. Durlach,et al.  Manual discrimination of force using active finger motion , 1991, Perception & psychophysics.

[29]  Shuo Yang,et al.  Detection of Torque Vibrations Transmitted Through a Passively-Held Rotary Switch , 2004 .

[30]  Daniel M Wolpert,et al.  Bayesian integration in force estimation. , 2004, Journal of neurophysiology.

[31]  Michael J. Griffin,et al.  Driver perception of steering feel , 2007 .

[32]  Thomas B. Sheridan,et al.  Man-machine systems;: Information, control, and decision models of human performance , 1974 .

[33]  Kay M. Stanney,et al.  Deriving haptic design guidelines from human physiological, psychophysical, and neurological foundations , 2004, IEEE Computer Graphics and Applications.

[34]  Ronald R. Mourant,et al.  Human Factors Issues in Virtual Environments: A Review of the Literature , 1998, Presence.

[35]  Haonan Tan,et al.  A Psychophysical Study of Sensory Saltation With an Open Response Paradigm , 2000, Dynamic Systems and Control: Volume 2.

[36]  F A Mussa-Ivaldi,et al.  Haptic interaction with virtual objects. Spatial perception and motor control. , 2000, Biological cybernetics.

[37]  Dominiek Reynaerts,et al.  Powerful Compact Tactile Display with Microhydraulic Actuators , 2008, EuroHaptics.

[38]  Marco Vicentini,et al.  Evaluation of Directional Force Threshold through Psychophysics Experiments , 2007 .

[39]  Astrid M.L. Kappers,et al.  Hand orientation is insufficiently compensated for in haptic spatial perception , 2006, Experimental Brain Research.

[40]  Kenneth O. Johnson,et al.  Tactile Functions of Mechanoreceptive Afferents Innervating the Hand , 2000, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[41]  John Kenneth Salisbury,et al.  Mechanical bandwidth as a guideline to high-performance manipulator design , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[42]  D. M. Green,et al.  A maximum-likelihood method for estimating thresholds in a yes-no task. , 1993, The Journal of the Acoustical Society of America.

[43]  Grigore C. Burdea,et al.  Force and Touch Feedback for Virtual Reality , 1996 .

[44]  M. Leek Adaptive procedures in psychophysical research , 2001, Perception & psychophysics.