Haptic Interaction Design for Everyday Interfaces

This chapter sets about to provide the background and orientation needed to set a novice designer on his or her way to bringing haptics successfully into an interactive product. To define appropriate roles for haptic interaction, it is necessary to integrate a basic awareness of human capabilities on one hand and current device technology on the other. Here, I explore this integration by first summarizing the most salient constraints imposed by both humans and hardware. I then proceed to relate perceptual, motor, and attentional capabilities to a selection of emerging application contexts chosen to be relevant to contemporary design trends and opportunities. These include abstract communication and notification, augmentation of graphical user interfaces, expressive control, affective communication, and mobile and handheld computing. Our touch (haptic) sense is such an integral part of our everyday experience that few of us really notice it. Notice it now, as you go about your business. Within and beneath our skin lie layers of ingenious and diverse tactile receptors comprising our tactile sensing subsystem. These receptors enable us to parse textures, assess temperature and material, guide dexterous manipulations, find a page’s edge to turn it, and deduce a friend’s mood from a touch of his hand. Intermingled with our muscle fibers and within our joints are load cells and position transducers making up our proprioceptive sense, which tell our nervous systems of a limb’s position and motion and the resistance it encounters. Without these and their close integration with our body’s motor control, it would be exceedingly difficult to break an egg neatly into a bowl, play a piano, walk without tripping, stroke a pet, write, draw, or even type. Touch is our earliest sense to develop (Montagu, 1986). It has evolved to work in a tight partnership with vision and hearing in many ways we are only beginning to understand, as we study processes (such as hand-eye coordination) and how we process conflicting or competing information from different senses. In stark contrast to the importance of touch in our everyday experience, the use of touch is marginalized in contemporary computer interfaces, overlooked in the rush to accommodate graphical capability in desktop-based systems. The primary advances have been in feel-focused improvements in nonactuated pointing tools for both function and aesthetics. Scroll wheels have been designed for the user to click with just the right resistance and frequency; and most cell phones now come with vibrators that indicate incoming calls. Meanwhile, the use of haptic feedback in the consumer sphere is largely limited to gaming, and tactile feedback to simple cell phone alerts.

[1]  Susan J. Lederman,et al.  The perceived roughness of resistive virtual textures: I. rendering by a force-feedback mouse , 2006, TAP.

[2]  Robert S Siegler,et al.  Development of rules and strategies: balancing the old and the new. , 2002, Journal of experimental child psychology.

[3]  A. F. Rovers,et al.  HIM: a framework for haptic instant messaging , 2004, CHI EA '04.

[4]  Jeremy N. Bailenson,et al.  Virtual Interpersonal Touch: Expressing and Recognizing Emotions Through Haptic Devices , 2007, Hum. Comput. Interact..

[5]  Karon E. MacLean,et al.  Manipulating music: multimodal interaction for DJs , 2004, CHI '04.

[6]  Christopher G. Atkeson,et al.  Predicting human interruptibility with sensors , 2005, TCHI.

[7]  Frank Tendick,et al.  Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[8]  Karon E. MacLean,et al.  Haptic techniques for media control , 2001, UIST '01.

[9]  Hong Z. Tan,et al.  The Body Surface as a Communication System: The State of the Art after 50 Years , 2007, PRESENCE: Teleoperators and Virtual Environments.

[10]  Lynette A. Jones,et al.  Development of a tactile vest , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[11]  Jerome Pasquero Survey on Communication through Touch , 2006 .

[12]  Hiroshi Ishii,et al.  ComTouch: design of a vibrotactile communication device , 2002, DIS '02.

[13]  Robert Swift Wigton,et al.  See one, do one, teach one , 1992 .

[14]  Frederick P. Brooks,et al.  Feeling and seeing: issues in force display , 1990, I3D '90.

[15]  Ali Shahrokni,et al.  One-dimensional force feedback slider: going from an analogue to a digital platform , 2006, NordiCHI '06.

[16]  Hong Z. Tan,et al.  Validity of haptic cues and its effect on priming visual spatial attention , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[17]  S Folkard,et al.  Effects of direction of rotation in continuous and discontinuous 8 hour shift systems , 2000, Occupational and environmental medicine.

[18]  Barry Kirwan,et al.  Investigating complexity factors in UK air traffic management , 2001 .

[19]  Ivan Poupyrev,et al.  Haptic feedback for pen computing: directions and strategies , 2004, CHI EA '04.

[20]  A. Kappers,et al.  Analysis of haptic perception of materials by multidimensional scaling and physical measurements of roughness and compressibility. , 2006, Acta psychologica.

[21]  N. Hogan,et al.  Robot-aided neurorehabilitation. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[22]  V. Hayward A brief taxonomy of tactile illusions and demonstrations that can be done in a hardware store , 2008, Brain Research Bulletin.

[23]  P. Anderson Touching: The Human Significance of the Skin , 1978 .

[24]  David B. Kaber,et al.  Adaptive Automation of Human-Machine System Information-Processing Functions , 2005, Hum. Factors.

[25]  Steven G. Rogelberg,et al.  Selection in Teams: An Exploration of the Teamwork Knowledge, Skills, and Ability Test , 2003 .

[26]  Mary L. Cummings,et al.  Developing Operator Capacity Estimates for Supervisory Control of Autonomous Vehicles , 2007, Hum. Factors.

[27]  Albert Kircher,et al.  Using mobile telephones: cognitive workload and attention resource allocation. , 2004, Accident; analysis and prevention.

[28]  Massimo Bergamasco,et al.  Teaching to write Japanese characters using a haptic interface , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[29]  Mandayam A. Srinivasan,et al.  The Effect of Auditory Cues on the Haptic Perception of Stiffness in Virtual Environments , 1997, Dynamic Systems and Control.

[30]  K. Sathian,et al.  Temporal Cues Contribute to Tactile Perception of Roughness , 2001, The Journal of Neuroscience.

[31]  Daniel G. Morrow,et al.  Improving Pilot/Air Traffic Control Voice Communication in General Aviation , 2002 .

[32]  Ravin Balakrishnan,et al.  Fluid interaction techniques for the control and annotation of digital video , 2003, UIST '03.

[33]  Karon E. MacLean,et al.  Haptic phonemes: basic building blocks of haptic communication , 2006, ICMI '06.

[34]  Shumin Zhai,et al.  Beyond Fitts' law: models for trajectory-based HCI tasks , 1997, CHI Extended Abstracts.

[35]  Sidney W A Dekker,et al.  How can ergonomics influence design? Moving from research findings to future systems , 2004, Ergonomics.

[36]  M Soede,et al.  Time analyses of the tasks of approach controllers in ATC. , 1971, Ergonomics.

[37]  F. J. Langdon,et al.  The Child's Conception of Space , 1967 .

[38]  Mark R. Cutkosky,et al.  System identification of the human hand grasping a haptic knob , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[39]  Shayne Loft,et al.  Modeling and Predicting Mental Workload in En Route Air Traffic Control: Critical Review and Broader Implications , 2007, Hum. Factors.

[40]  T. Field,et al.  Preschoolers in America are touched less and are more aggressive than preschoolers in France , 1999 .

[41]  John Cohen The World of Touch , 1952, Nature.

[42]  Charles Spence,et al.  Spatial synergies between auditory and visual attention. , 1994 .

[43]  S T Shorrock,et al.  A framework for managing system disturbances and insights from air traffic management , 2006, Ergonomics.

[44]  Katherine J. Kuchenbecker,et al.  Improving contact realism through event-based haptic feedback , 2006, IEEE Transactions on Visualization and Computer Graphics.

[45]  Aj Bert Bongers Tactile display in electronic musical instruments , 1997 .

[46]  D. Norman Emotional design : why we love (or hate) everyday things , 2004 .

[47]  Simone Gumtau Tactile semiotics: the meanings of touch explored with low-tech prototypes , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[48]  Christopher D. Wickens,et al.  The Structure of Attentional Resources , 1980 .

[49]  R. Howe,et al.  Identification of the mechanical impedance at the human finger tip. , 1997, Journal of biomechanical engineering.

[50]  David B. Camarillo,et al.  Robotic technology in surgery: past, present, and future. , 2004, American journal of surgery.

[51]  Karon E. MacLean,et al.  Capturing the Dynamics of Mechanical Knobs , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[52]  Mark Holliins,et al.  Perceptual dimensions of tactile surface texture: A multidimensional scaling analysis , 1993, Perception & psychophysics.

[53]  K.E. MaClean,et al.  Smart tangible displays in the everyday world: a haptic door knob , 1999, 1999 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (Cat. No.99TH8399).

[54]  Charles Nichols The vBow: Development of a Virtual Violin Bow Controller Haptic Human-Computer Interface , 2002, NIME.

[55]  Paul Dourish,et al.  Introduction to This Special Issue on Context-Aware Computing , 2001, Hum. Comput. Interact..

[56]  William W. Gaver Synthesizing auditory icons , 1993, INTERCHI.

[57]  Chris Chafe,et al.  Playing by feel: incorporating haptic feedback into computer-based musical instruments , 2001 .

[58]  David K. Schmidt,et al.  On modeling ATC work load and sector capacity , 1976 .

[59]  Vincent Hayward,et al.  A role for haptics in mobile interaction: initial design using a handheld tactile display prototype , 2006, CHI.

[60]  R. Klatzky,et al.  Action for Perception: Manual Exploratory Movements for Haptically Processing Objects and Their Features , 1996 .

[61]  Vincent Hayward,et al.  Braille Display by Lateral Skin Deformation with the STReSS2 Tactile Transducer , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[62]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[63]  Karon E. MacLean,et al.  Perceiving ordinal data haptically under workload , 2005, ICMI '05.

[64]  Karon E. MacLean,et al.  Designing haptic icons to support collaborative turn-taking , 2008, Int. J. Hum. Comput. Stud..

[65]  Hester Coan,et al.  Risk, error and blame in organizations: a communication approach , 2002 .

[66]  Brent Gillespie Haptics in manipulation , 1999 .

[67]  R. T. Verrillo,et al.  Vibration Sensation in Humans , 1992 .

[68]  B. E. Miller,et al.  Using a wavelet network to characterize real environments for haptic display , 1998 .

[69]  J. Edward Colgate,et al.  T-PaD: Tactile Pattern Display through Variable Friction Reduction , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[70]  Vincent Hayward,et al.  Do it yourself haptics: part I , 2007, IEEE Robotics & Automation Magazine.

[71]  Alex Pentland,et al.  Human computing and machine understanding of human behavior: a survey , 2006, ICMI '06.

[72]  Abhishek Gupta,et al.  Shared Control in Haptic Systems for Performance Enhancement and Training , 2006 .

[73]  Francis T. Durso,et al.  Talk to Me, Goose. , 2007 .

[74]  Esa M. Rantanen,et al.  Evaluation of Airspace Complexity and Dynamic Density Metrics Derived from Operational Data , 2007 .

[75]  Norbert Mai,et al.  Maintenance of low isometric forces during prehensile grasping , 1985, Neuropsychologia.

[76]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[77]  T. Wickens Elementary Signal Detection Theory , 2001 .

[78]  Karon E. MacLean,et al.  The Role of Choice in Longitudinal Recall of Meaningful Tactile Signals , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[79]  Joachim Vogt,et al.  The Impact of Workload on Heart Rate and Blood Pressure in En-Route and Tower Air Traffic Control , 2006 .

[80]  Glenn F. Wilson,et al.  Operator Functional State Classification Using Multiple Psychophysiological Features in an Air Traffic Control Task , 2003, Hum. Factors.

[81]  J. C. Sperandio,et al.  Variation of Operator's Strategies and Regulating Effects on Workload , 1971 .

[82]  C. Spence,et al.  Crossmodal Space and Crossmodal Attention , 2004 .

[83]  Philippa Gander,et al.  FATIGUE MANAGEMENT IN AIR TRAFFIC CONTROL: THE NEW ZEALAND APPROACH , 2001 .

[84]  Natalie C. Barraga,et al.  Visual handicaps and learning , 1992 .

[85]  Peng Zhao,et al.  User interfaces for interactive control of physics-based 3D characters , 2005, I3D '05.

[86]  Hong Z. Tan,et al.  An analysis of perceptual instability during haptic texture rendering , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[87]  Erik V. Jansson,et al.  On Vibration Sensation and Finger Touch in Stringed Instrument Playing , 1992 .

[88]  W. Wierwille,et al.  A Comparison of Rating Scale, Secondary-Task, Physiological, and Primary-Task Workload Estimation Techniques in a Simulated Flight Task Emphasizing Communications Load , 1983, Human factors.

[89]  Karon E. MacLean,et al.  Perceptual Analysis of Haptic Icons: an Investigation into the Validity of Cluster Sorted MDS , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[90]  Sidney W. A. Dekker,et al.  To Intervene or not to Intervene: The Dilemma of Management by Exception , 1999, Cognition, Technology & Work.

[91]  Heinrich H. Bülthoff,et al.  Cross-modal perception of actively explored objects , 2003 .

[92]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[93]  Vincent Hayward,et al.  Haptically Enabled Handheld Information Display With Distributed Tactile Transducer , 2007, IEEE Transactions on Multimedia.

[94]  Shahram Payandeh Application of shared control strategy in the design of a robotic device , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[95]  Lynne Martin,et al.  THE IMPACT OF VOICE, DATA LINK, AND MIXED AIR TRAFFIC CONTROL ENVIRONMENTS ON FLIGHT DECK PROCEDURES , 2003 .

[96]  Peter Brooker,et al.  Air Traffic Management accident risk. Part 1: The limits of realistic modelling , 2006 .

[97]  Virpi Roto,et al.  Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI , 2005, CHI.

[98]  S O'Modhrain Touch and Go — Designing Haptic Feedback for a Hand-Held Mobile Device , 2004 .

[99]  Donald A. Norman,et al.  Emotion & design: attractive things work better , 2002, INTR.

[100]  M. Heller The Psychology of Touch , 1991 .

[101]  Gerald R. Ferris,et al.  Cognitive Ability and Personality Predictors of Training Program Skill Acquisition and Job Performance , 2001 .

[102]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[103]  Ian Oakley,et al.  Tilt to scroll: evaluating a motion based vibrotactile mobile interface , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[104]  O V Prinzo Effects of Communication Modes and Data Linked Pilot Reply Time on Controller Workload and Communication Tasks in a Simulated Terminal Airspace , 2002 .

[105]  Albert Boquet,et al.  Clockwise and counterclockwise rotating shifts: effects on vigilance and performance. , 2003, Aviation, space, and environmental medicine.

[106]  Dinesh K. Pai,et al.  A unified treatment of elastostatic contact simulation for real time haptics , 2005, SIGGRAPH Courses.

[107]  R. R. Hunt,et al.  The cost of event-based prospective memory: salient target events. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[108]  A. Bruce Emotional Expression , 1883, The American Naturalist.

[109]  J. Gibson Observations on active touch. , 1962, Psychological review.

[110]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[111]  J. Sperandio The regulation of working methods as a function of work-load among air traffic controllers. , 1978, Ergonomics.

[112]  Francis T. Durso,et al.  Planning in Air Traffic Control: Impact of Problem Type , 2005 .

[113]  Karon E. MacLean,et al.  Predictive haptic guidance: intelligent user assistance for the control of dynamic tasks , 2006, IEEE Transactions on Visualization and Computer Graphics.

[114]  Richard H. Mogford,et al.  Mental Models and Situation Awareness in Air Traffic Control , 1997 .

[115]  D. H. Warren,et al.  The role of visual-auditory “compellingness” in the ventriloquism effect: Implications for transitivity among the spatial senses , 1981, Perception & psychophysics.

[116]  Scott M. Galster,et al.  Air Traffic Controller Performance and Workload Under Mature Free Flight: Conflict Detection and Resolution of Aircraft Self-Separation , 2001 .

[117]  Karol Kerns DATA-LINK COMMUNICATION BETWEEN CONTROLLERS AND PILOTS: A REVIEW AND SYNTHESIS OF THE SIMULATION LITERATURE. , 1991 .

[118]  Henk A. P. Blom,et al.  Human cognition performance model to evaluate safe spacing in air traffic , 2002 .

[119]  C. Spence,et al.  The failure to detect tactile change: A tactile analogue of visual change blindness , 2006, Psychonomic bulletin & review.

[120]  Hong Z. Tan,et al.  Toward realistic haptic rendering of surface textures , 2004 .

[121]  Vincenzo Natale,et al.  Effects of circadian typology on sleep–wake behavior of air traffic controllers , 2003, Psychiatry and clinical neurosciences.

[122]  Douglas H. Porterfield Evaluating Controller Communication Time As a Measure of Workload , 1997 .

[123]  Karon E. MacLean,et al.  Exploring affective design for physical controls , 2007, CHI.

[124]  Francis T. Durso,et al.  The cooperative shift change: an illustration using air traffic control , 2007 .

[125]  Shumin Zhai,et al.  What You Feel Must Be What You See: Adding Tactile Feedback to the Trackpoint , 1999, INTERACT.

[126]  Klaus Eyferth,et al.  Securing future ATM-concepts' safety by measuring situation awareness in ATC , 2003 .

[127]  John Kenneth Salisbury,et al.  Haptic Feedback Enhances Force Skill Learning , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[128]  Dinesh K. Pai,et al.  Perception of Material from Contact Sounds , 2000, Presence: Teleoperators & Virtual Environments.

[129]  Louis B. Rosenberg “Virtual fixtures”: perceptual overlays enhance operator performance in telepresence tasks , 1994 .

[130]  Frederick P. Brooks,et al.  Project GROPEHaptic displays for scientific visualization , 1990, SIGGRAPH.

[131]  Philip L. Powell,et al.  Decision Support for Flight Re-Routing in Europe , 2003, ECIS.

[132]  T B Sheridan,et al.  The “Feel” of Rotary Controls: Friction and Inertia1 , 1966, Human factors.

[133]  Yuichiro Kume,et al.  Vibrotactile letter reading using a low-resolution tactor array , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[134]  C. Davis Touch , 1997, The Lancet.

[135]  C. Perricone,et al.  The Place of Touch in the Arts , 2007, Journal of Aesthetic Education.

[136]  Karon E. MacLean,et al.  Handheld haptics: a USB media controller with force sensing , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[137]  Perry R. Cook,et al.  Principles for Designing Computer Music Controllers , 2001, NIME.

[138]  Robin Jeffries,et al.  CHI '06 Extended Abstracts on Human Factors in Computing Systems , 2006, CHI 2006.

[139]  Steve Mann "fl Huge UId streams": fountains that are keyboards with nozzle spray as keys that give rich tactile feedback and are more expressive and more fun than plastic keys , 2005, MULTIMEDIA '05.

[140]  R. Klatzky,et al.  Tactile roughness perception with a rigid link interposed between skin and surface , 1999, Perception & psychophysics.

[141]  William W. Gaver,et al.  Feather, Scent, and Shaker: Supporting Simple Intimacy , 1996 .

[142]  C. W. Simon Some Immediate Effects of Drowsiness and Sleep on Normal Human Performance1 , 1961 .

[143]  Gregory D. Hager,et al.  Human-Machine Collaborative Systems for Microsurgical Applications , 2005, Int. J. Robotics Res..

[144]  Simone Pozzi,et al.  Predicting and simulating human errors in using the airborne separation assurance system procedure , 2005 .

[145]  K. MacLean,et al.  The Haptic Creature Project : Social Human-Robot Interaction through Affective Touch , 2008 .

[146]  C Niessen,et al.  Modelling cognitive processes of experienced air traffic controllers. , 1999, Ergonomics.

[147]  Charles Spence Crossmodal attention , 1998, Scholarpedia.

[148]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[149]  Hong Z. Tan,et al.  Discrimination of Real and Virtual High-Definition Textured Surfaces , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[150]  Mark R. Cutkosky,et al.  Feedback strategies for shared control in dexterous telemanipulation , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[151]  Arthur C. Grant,et al.  Tactile perception in blind Braille readers: A psychophysical study of acuity and hyperacuity using gratings and dot patterns , 2000, Perception & psychophysics.

[152]  Karon E. MacLean,et al.  Hapticat: exploration of affective touch , 2005, ICMI '05.

[153]  Kip Smith,et al.  An Index of Dynamic Density , 1998, Hum. Factors.

[154]  Peter Brooker Are There Good Air Traffic Management Safety Indicators For Very Safe Systems , 2007 .

[155]  B. Stein Neural mechanisms for synthesizing sensory information and producing adaptive behaviors , 1998, Experimental Brain Research.

[156]  P. Wiseman The Virtual Teacher , 1998 .

[157]  P. Bach-y-Rita,et al.  Form perception with a 49-point electrotactile stimulus array on the tongue: a technical note. , 1998, Journal of rehabilitation research and development.

[158]  A. M. Smith,et al.  Subjective scaling of smooth surface friction. , 1996, Journal of neurophysiology.

[159]  Maureen S. Battistella,et al.  Connections: New Ways of Working in the Networked Organization , 1991 .

[160]  C. Wetzel,et al.  The Midas Touch , 1984 .

[161]  R. Klatzky,et al.  Feeling textures through a probe: Effects of probe and surface geometry and exploratory factors , 2003, Perception & psychophysics.

[162]  M. Hollins,et al.  Evidence for the duplex theory of tactile texture perception , 2000, Perception & psychophysics.

[163]  Peter M. Moertl,et al.  Aiding Planning in Air Traffic Control: An Experimental Investigation of the Effects of Perceptual Information Integration , 2002, Hum. Factors.

[164]  G. A. Mendelsohn,et al.  Affect grid : A single-item scale of pleasure and arousal , 1989 .

[165]  B. Montero,et al.  Proprioception as an Aesthetic Sense , 2006 .

[166]  M. Sile O'Modhrain,et al.  Cutaneous Grooves: Composing for the Sense of Touch , 2002 .

[167]  Ranjan Mukherjee,et al.  A shared-control approach to haptic interface design for minimally invasive telesurgical training , 2005, IEEE Transactions on Control Systems Technology.

[168]  K. Johnson,et al.  Neural coding of tactile texture: comparison of spatial and temporal mechanisms for roughness perception , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[169]  A Bisseret Analysis of mental processes involved in air traffic control. , 1971, Ergonomics.

[170]  Wayne A. Hershberger,et al.  Touch dominates haptic estimates of discordant visual-haptic size , 1996, Perception & psychophysics.

[171]  Eric Ruthruff,et al.  Visual Search in Complex Displays: Factors Affecting Conflict Detection by Air Traffic Controllers , 2000, Hum. Factors.

[172]  David J. Schroeder,et al.  Air Traffic Control Specialist Age and En Route Operational Errors , 2006 .

[173]  Ian Oakley,et al.  Guidelines for the Design of Haptic Widgets , 2002 .

[174]  E. Macaluso,et al.  Supramodal Effects of Covert Spatial Orienting Triggered by Visual or Tactile Events , 2002, Journal of Cognitive Neuroscience.

[175]  Timothy S. Miller,et al.  An insidious Haptic invasion: adding force feedback to the X desktop , 1998, UIST '98.

[176]  Scott Brave,et al.  inTouch: a medium for haptic interpersonal communication , 1997, CHI Extended Abstracts.

[177]  Annie Luciani,et al.  From action to sound: a challenging perspective for haptics , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[178]  William V. Baxter,et al.  DAB: Interactive Haptic Painting with 3D Virtual Brushes , 2001, SIGGRAPH Courses.

[179]  Heather Menzies,et al.  No Time: Stress and the Crisis of Modern Life , 2005 .

[180]  B. Berenson,et al.  North Italian Painters Of The Renaissance , 1907 .

[181]  Fabio Paternò,et al.  Preventing user errors by systematic analysis of deviations from the system task model , 2002, Int. J. Hum. Comput. Stud..

[182]  Lorna M. Brown,et al.  Multidimensional tactons for non-visual information presentation in mobile devices , 2006, Mobile HCI.

[183]  Cagatay Basdogan,et al.  Haptics in virtual environments: taxonomy, research status, and challenges , 1997, Comput. Graph..

[184]  Bert Bongers,et al.  Physical Interfaces in the Electronic Arts Interaction Theory and Interfacing Techniques for Real-time Performance , 2000 .

[185]  Tsuneo Yoshikawa,et al.  Haptic display device with fingertip presser for motion/force teaching to human , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[186]  Esa M. Rantanen,et al.  Time Delays in Air Traffic Control Communication Loop: Effect on Controller Performance and Workload , 2004 .

[187]  Susan Leigh Foster,et al.  Reading Dancing: Bodies and Subjects in Contemporary American Dance , 1987 .

[188]  Karon E. MacLean,et al.  Impact of haptic warning signal reliability in a time-and-safety-critical task , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[189]  J. Horne,et al.  The impact of sleep deprivation on decision making: a review. , 2000, Journal of experimental psychology. Applied.

[190]  R. Heslin,et al.  Hands touching hands: affective and evaluative effects of an interpersonal touch. , 1976, Sociometry.

[191]  Cagatay Basdogan,et al.  An experimental study on the role of touch in shared virtual environments , 2000, TCHI.

[192]  Randy Borum,et al.  Forensic Assessment for High Risk Occupations , 2003 .

[193]  K. B. Shimoga,et al.  Finger Force and Touch Feedback Issues in Dexterous Telemanipulation , 1992, Proceedings. Fourth Annual Conference on Intelligent Robotic Systems for Space Exploration.

[194]  Colin Swindells,et al.  Incorporating affect into the design of 1-d rotary physical controls , 2007 .

[195]  Kim Cardosi OPERATIONAL ERRORS IN AIR TRAFFIC CONTROL TOWERS , 2002 .

[196]  Raja Parasuraman,et al.  The Role of the Air Traffic Controller in Future Air Traffic Management: An Empirical Study of Active Control versus Passive Monitoring , 2001, Hum. Factors.

[197]  M. A. Srinivassan The impact of visual information on the haptic perception of stiffness in virtual environments , 1996 .

[198]  A. Yuille,et al.  Bayesian decision theory and psychophysics , 1996 .

[199]  Wijnand A. IJsselsteijn,et al.  Mediated social touch: a review of current research and future directions , 2006, Virtual Reality.

[200]  C. Spence,et al.  Tactile dominance in speeded discrimination of textures , 2003, Experimental Brain Research.

[201]  J. Napier The prehensile movements of the human hand. , 1956, The Journal of bone and joint surgery. British volume.

[202]  William A. Owens,et al.  MODERATORS AND SUBGROUPS , 1978 .

[203]  K. Nesbitt,et al.  Experimenting with Haptic Attributes for Display of Abstract Data , 2002 .

[204]  Charlotte M Reed,et al.  Temporal masking of multidimensional tactual stimuli. , 2003, The Journal of the Acoustical Society of America.

[205]  Max V. Mathews,et al.  The PLANK: Designing a simple Haptic Controller , 2002, NIME.

[206]  Vincent Hayward,et al.  Force can overcome object geometry in the perception of shape through active touch , 2001, Nature.

[207]  Nadine Sarter,et al.  Multimodal information presentation: Design guidance and research challenges , 2006 .

[208]  James L. Szalma,et al.  The future of neuroergonomics , 2003 .

[209]  Karon E. MacLean,et al.  Evaluation of haptically augmented touchscreen gui elements under cognitive load , 2007, ICMI '07.

[210]  Michael Kastner,et al.  STRESS IN MODERN AIR TRAFFIC CONTROL SYSTEMS AND POTENTIAL INFLUENCES ON MEMORY , 2002 .

[211]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[212]  Mica R. Endsley,et al.  Situation Awareness Information Requirements Analysis for En Route Air Traffic Control , 1994 .

[213]  William S. Pawlak,et al.  A FRAMEWORK FOR THE EVALUATION OF AIR TRAFFIC CONTROL COMPLEXITY , 1996 .

[214]  Andrew R. Dattel,et al.  Does Situation Awareness Add to the Validity of Cognitive Tests? , 2006, Hum. Factors.

[215]  Alvaro Pascual-Leone,et al.  Cortical plasticity associated with Braille learning , 1998, Trends in Cognitive Sciences.

[216]  J. Edward Colgate,et al.  Factors affecting the Z-Width of a haptic display , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[217]  Cagatay Basdogan,et al.  Surgical Simulation: An Emerging Technology for Training in Emergency Medicine , 1997, Presence: Teleoperators & Virtual Environments.

[218]  Jean-Marie Cellier,et al.  Accuracy of Estimations Made by Air Traffic Controllers , 2000 .

[219]  Karon E. MacLean,et al.  Communicating emotion through a haptic link: Design space and methodology , 2007, Int. J. Hum. Comput. Stud..

[220]  Ulf Ahlstrom,et al.  Work domain analysis for air traffic controller weather displays. , 2005, Journal of safety research.

[221]  M. Lévesque Perception , 1986, The Yale Journal of Biology and Medicine.

[222]  W. Knecht,et al.  A Dynamic Conflict Probe and Index of Collision Risk , 1996 .

[223]  Teresa C. D'Oliveira,et al.  Dynamic Spatial Ability: An Exploratory Analysis and a Confirmatory Study , 2004 .

[224]  Karon E. MacLean,et al.  A case-study of affect measurement tools for physical user interface design , 2006, Graphics Interface.

[225]  Karon E. MacLean,et al.  Designing Large Sets of Haptic Icons with Rhythm , 2008, EuroHaptics.

[226]  Etienne Burdet,et al.  A robotic teacher of Chinese handwriting , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[227]  Raja Parasuraman,et al.  Effects of Automated Conflict Cuing and Traffic Density on Air Traffic Controller Performance and Visual Attention in a Datalink Environment , 2006 .

[228]  John Kenneth Salisbury,et al.  Haptic Rendering: Introductory Concepts , 2004, IEEE Computer Graphics and Applications.

[229]  Susanna Millar,et al.  Memory in touch , 1999 .

[230]  Giulio Sandini,et al.  Cognitive Systems , 2005 .

[231]  Nadine B. Sarter,et al.  Not Now! Supporting Interruption Management by Indicating the Modality and Urgency of Pending Tasks , 2004, Hum. Factors.

[232]  B. Hughes,et al.  Haptic Exploration and the Perception of Texture Orientations , 2006 .

[233]  Jon Driver,et al.  Crossmodal Spatial Attention: Evidence from Human Performance , 2004 .

[234]  P. Jordan Designing Pleasurable Products: An Introduction to the New Human Factors , 2000 .

[235]  Michela Terenzi,et al.  Procedural errors in air traffic control: effects of traffic density, expertise, and automation. , 2006, Aviation, space, and environmental medicine.

[236]  R. Colom,et al.  The Assessment of Spatial Ability with a Single Computerized Test , 2003 .

[237]  Perry R. Cook,et al.  Music, cognition, and computerized sound: an introduction to psychoacoustics , 1999 .

[238]  Roel Vertegaal,et al.  Using mental load for managing interruptions in physiologically attentive user interfaces , 2004, CHI EA '04.

[239]  Christopher R. Wagner,et al.  The Benefit of Force Feedback in Surgery: Examination of Blunt Dissection , 2007, PRESENCE: Teleoperators and Virtual Environments.

[240]  Jun Rekimoto,et al.  Ambient touch: designing tactile interfaces for handheld devices , 2002, UIST '02.

[241]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[242]  Karon E. MacLean,et al.  Learning and identifying haptic icons under workload , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[243]  J.B.F. van Erp,et al.  Multi-finger haptic interaction within the MIAMM project , 2002 .

[244]  Hong Z. Tan,et al.  Dynamic and predictive links between touch and vision , 2002, Experimental Brain Research.

[245]  Lynette A. Jones,et al.  Tactile Displays: Guidance for Their Design and Application , 2008, Hum. Factors.

[246]  Eric Horvitz,et al.  Models of attention in computing and communication , 2003, Commun. ACM.

[247]  Sidney S. Simon,et al.  Merging of the Senses , 2008, Front. Neurosci..

[248]  Danko Nikolić,et al.  SITUATION AWARENESS AS A PREDICTOR OF PERFORMANCE IN EN ROUTE AIR TRAFFIC CONTROLLERS , 1998 .

[249]  Lorna M. Brown,et al.  Feel who's talking: using tactons for mobile phone alerts , 2006, CHI Extended Abstracts.

[250]  Russell H. Taylor,et al.  A Steady-Hand Robotic System for Microsurgical Augmentation , 1999, Int. J. Robotics Res..

[251]  Andrew R. Dattel,et al.  The Cambridge Handbook of Expertise and Expert Performance: Expertise and Transportation , 2006 .

[252]  Vincent Hayward,et al.  Fundamental limits in the rendering of virtual haptic textures , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[253]  Alan Kingstone,et al.  Is inhibition of return a reflexive effect? , 2005, Cognition.

[254]  Harvey S. Smallman,et al.  The Use of 2D and 3D Displays for Shape-Understanding versus Relative-Position Tasks , 2001, Hum. Factors.

[255]  Robert D. Howe,et al.  Tactile Display of Vibratory Information in Teleoperation and Virtual Environments , 1995, Presence: Teleoperators & Virtual Environments.

[256]  Kirsten Rassmus-Gröhn,et al.  Supporting presence in collaborative environments by haptic force feedback , 2000, TCHI.

[257]  Ivan Poupyrev,et al.  Tactile interfaces for small touch screens , 2003, UIST '03.

[258]  Ming C. Lin,et al.  High Fidelity Haptic Rendering , 2006, High Fidelity Haptic Rendering.

[259]  C. Spence,et al.  Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision , 1998, Perception & psychophysics.

[260]  Carol A. Manning,et al.  The Use of Flight Progress Strips While Working Live Traffic: Frequencies, Importance, and Perceived Benefits , 2004, Hum. Factors.

[261]  David B. Kaber,et al.  Situation awareness implications of adaptive automation for information processing in an air traffic control-related task , 2006 .

[262]  Forrest W. Young,et al.  Individual differences in perceptual space for tactile textures: Evidence from multidimensional scaling , 2000, Perception & psychophysics.

[263]  R. Satava Emerging technologies for surgery in the 21st century. , 1999, Archives of surgery.

[264]  Jeha Ryu,et al.  Haptics in Virtual Environments , 2003 .

[265]  Jeremiah Scholl,et al.  Managing Communication Availability and Interruptions: A Study of Mobile Communication in an Oncology Department , 2007, Pervasive.

[266]  Kim Cardosi,et al.  Metrics of Communication Performance , 2004 .

[267]  M. Sile O'Modhrain,et al.  The Virtual Teacher , 1999 .

[268]  .. Wanderley Typology of Tactile Sounds and their Synthesis in Gesture-Driven Computer Music Performance , 2000 .

[269]  Jacob Hornik,et al.  Tactile Stimulation and Consumer Response , 1992 .

[270]  S J Bensmaïa,et al.  Complex tactile waveform discrimination. , 2000, The Journal of the Acoustical Society of America.

[271]  Nicolas Guéguen,et al.  Nonverbal Encouragement of Participation in a Course: the Effect of Touching , 2004 .

[272]  Simone Gumtau Freshly squeezed touch into bits: towards the development of a haptic design palette , 2006, Virtual Reality.

[273]  Francis T. Durso,et al.  En Route Operational Errors and Situational Awareness , 1998 .

[274]  B. Bonger Tactile display in electronic musical instruments , 1997 .

[275]  Alex Pentland,et al.  Tactual displays for sensory substitution and wearable computers , 2005, SIGGRAPH Courses.

[276]  B. J. Fogg,et al.  HandJive: a device for interpersonal haptic entertainment , 1998, CHI.

[277]  André Dittmar,et al.  Mental workload in air traffic control: an index constructed from field tests. , 2004, Aviation, space, and environmental medicine.

[278]  R M Rose,et al.  Objective job difficulty, behavioural response, and sector characteristics in air route traffic control centres. , 1978, Ergonomics.

[279]  M Akamatsu,et al.  Please Scroll down for Article Ergonomics a Comparison of Tactile, Auditory, and Visual Feedback in a Pointing Task Using a Mouse-type Device , 2022 .

[280]  Jonathan Grudin,et al.  Why CSCW Applications Fail: Problems in the Design and Evaluation of Organization of Organizational Interfaces. , 1988 .

[281]  R. Brent Gillespie,et al.  Shared control between human and machine: haptic display of automation during manual control of vehicle heading , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[282]  Karon E. MacLean,et al.  Perceptual Design of Haptic Icons , 2003 .

[283]  Karon E. MacLean,et al.  AN ARCHITECTURE FOR HAPTIC CONTROL OF MEDIA , 1999 .

[284]  Arthur E. Kirkpatrick,et al.  A new approach to haptic augmentation of the GUI , 2006, ICMI '06.

[285]  Vincent Hayward,et al.  Haptic interfaces and devices , 2004 .

[286]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[287]  Roger Remington,et al.  Prospective memory in dynamic environments: Effects of load, delay, and phonological rehearsal , 2001, Memory.

[288]  Mark R. Cutkosky,et al.  Stable User-Specific Haptic Rendering of the Virtual Wall , 1996, Dynamic Systems and Control.

[289]  J. C. Bliss,et al.  A direct translation reading aid for the blind , 1966 .

[290]  J. Mathieu,et al.  Investigating linear and interactive effects of shared mental models on safety and efficiency in a field setting. , 2005, The Journal of applied psychology.

[291]  Cagatay Basdogan,et al.  Haptic Rendering in Virtual Environments , 2002 .

[292]  V. Hayward,et al.  An Experiment on Length Perception with a Virtual Rolling Stone , 2006 .

[293]  Tom Igoe Physical Computing , 2004 .

[294]  Mario J. Enriquez,et al.  A pneumatic tactile alerting system for the driving environment , 2001, PUI '01.

[295]  John Vozenilek,et al.  See one, do one, teach one: advanced technology in medical education. , 2004, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[296]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[297]  S. Schultz Principles of Neural Science, 4th ed. , 2001 .

[298]  Mary Beth Rosson,et al.  CHI '07 Extended Abstracts on Human Factors in Computing Systems , 2007, CHI 2007.

[299]  Y. Matsuoka,et al.  Robotics for surgery. , 1999, Annual review of biomedical engineering.

[300]  Karon E. MacLean,et al.  Foundations of Transparency in Tactile Information Design , 2008, IEEE Transactions on Haptics.

[301]  I ROCK,et al.  Vision and Touch: An Experimentally Created Conflict between the Two Senses , 1964, Science.

[302]  Shayne Loft,et al.  An analysis of relational complexity in an air traffic control conflict detection task , 2006, Ergonomics.

[303]  Kevin Corker A Cognitive Framework for Operation of Advanced Aerospace Technologies , 2003 .

[304]  Bruce Randall Donald,et al.  Using haptic vector fields for animation motion control , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[305]  J C Craig,et al.  Vibrotactile pattern perception: extraordinary observers. , 1977, Science.

[306]  C. Cruz,et al.  Effects of quick rotating shift schedules on the health and adjustment of air traffic controllers. , 2000, Aviation, space, and environmental medicine.

[307]  Ehud Ahissar,et al.  Importance of Temporal Cues for Tactile Spatial- Frequency Discrimination , 2001, The Journal of Neuroscience.

[308]  Soledad Ballesteros,et al.  The perception of ecological textures by touch: does the perceptual space change under bimodal visual and haptic exploration? , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[309]  Blake Hannaford,et al.  Virtual Training for a Manual Assembly Task , 2001 .

[310]  Topi Kaaresoja,et al.  Novel, minimalist haptic gesture interaction for mobile devices , 2004, NordiCHI '04.

[311]  Ryan M. Traylor,et al.  A Haptic Back Display for Attentional and Directional Cueing , 2003 .

[312]  Karon E. MacLean,et al.  Designing with haptic feedback , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[313]  S. Gronlund,et al.  Role of memory in air traffic control. , 1998 .

[314]  Roderick Murray-Smith,et al.  Devices as interactive physical containers: the shoogle system , 2007, CHI Extended Abstracts.

[315]  Kenneth Y. Goldberg,et al.  Collaborative teleoperation via the Internet , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[316]  Hendrik A. H. C. van Veen,et al.  Waypoint navigation with a vibrotactile waist belt , 2005, TAP.

[317]  Martin R. Gibbs,et al.  Hug over a distance , 2005, CHI Extended Abstracts.

[318]  Jack Tigh Dennerlein,et al.  Force-feedback improves performance for steering and combined steering-targeting tasks , 2000, CHI.

[319]  J. Craig Tactile pattern perception and its perturbations. , 1985, The Journal of the Acoustical Society of America.

[320]  Michiel M. Spapé,et al.  Distilling the underlying dimensions of tactile melodies , 2003 .

[321]  Leonardo Bonanni,et al.  TapTap: a haptic wearable for asynchronous distributed touch therapy , 2006, CHI Extended Abstracts.

[322]  H. Bastian Sensation and Perception.—I , 1869, Nature.

[323]  Meera Blattner,et al.  Earcons and Icons: Their Structure and Common Design Principles , 1989, Hum. Comput. Interact..

[324]  Susan J. Lederman,et al.  Multisensory Texture Perception , 2010 .

[325]  Karon E. MacLean,et al.  Backward and common-onset masking of vibrotactile stimuli , 2008, Brain Research Bulletin.

[326]  Albrecht Schmidt,et al.  There is more to context than location , 1999, Comput. Graph..

[327]  J.B.F. van Erp,et al.  A multi-purpose tactile vest for astronauts in the international space station , 2003 .

[328]  J.B.F. van Erp,et al.  Providing directional information with tactile torso displays , 2003 .

[329]  Scott R. Klemmer,et al.  Papier-Mache: toolkit support for tangible input , 2004, CHI.

[330]  G. Essick,et al.  Psychophysical assessment of the affective components of non-painful touch. , 1999, Neuroreport.

[331]  John Duncan,et al.  Restricted attentional capacity within but not between sensory modalities , 1997, Nature.

[332]  M. Heller,et al.  Intersensory conflict between vision and touch: The response modality dominates when precise, attention-riveting judgments are required , 1999, Perception & psychophysics.

[333]  Roy Want,et al.  Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces , 1998, CHI.

[334]  María José Contreras,et al.  Two short tests fail to detect vigilance decrements. , 2001 .