Haptic Addition to a Visual Menu Selection Interface Controlled by an In-Vehicle Rotary Device

Today, several vehicles are equipped with a visual display combined with a haptic rotary device for handling in-vehicle information system tasks while driving. This experimental study investigates whether a haptic addition to a visual interface interferes with or supports secondary task performance and whether haptic information could be used without taking eyes off road. Four interfaces were compared during simulated driving: visual only, partly corresponding visual-haptic, fully corresponding visual-haptic, and haptic only. Secondary task performance and subjective mental workload were measured. Additionally, the participants were interviewed. It was found that some haptic support improved performance. However, when more haptic information was used, the results diverged in terms of task completion time and interface comprehension. Some participants did not sense all haptics provided, some did not comprehend the correspondence between the haptic and visual interfaces, and some did. Interestingly, the participants managed to complete the tasks when using haptic-only information.

[1]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[2]  P. Mcdonnell,et al.  Vision and touch: a reconsideration of conflict between the two senses. , 1972, Canadian journal of psychology.

[3]  M Mulder,et al.  Haptic gas pedal feedback , 2008, Ergonomics.

[4]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[5]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[6]  J. Gibson.  Observations on active touch. , 1962, Psychological review.

[7]  Edouard Gentaz,et al.  Chapter 8. Haptic processing of spatial and material object properties , 2003 .

[8]  Karon E. MacLean,et al.  Perceiving ordinal data haptically under workload , 2005, ICMI '05.

[9]  Gary Burnett,et al.  BIONIC: 'eyes-free' design of secondary driving controls , 2005 .

[10]  Peter Bengtsson,et al.  Menu selection based on haptic and/or graphic information , 2005 .

[11]  C Spence,et al.  Multisensory interface design for drivers: past, present and future , 2008, Ergonomics.

[12]  A. Michael Huberman,et al.  An expanded sourcebook qualitative data analysis , 1994 .

[13]  C. Spence,et al.  What role does multisensory integration play in the visuotactile perception of texture? , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[14]  Filomena Ferrucci,et al.  Handy: A New Interaction Device for Vehicular Information Systems , 2004, Mobile HCI.

[15]  I ROCK,et al.  Vision and Touch: An Experimentally Created Conflict between the Two Senses , 1964, Science.

[16]  Peter Bengtsson,et al.  Can Haptics Facilitate Interaction with an In-Vehicle Multifunctional Interface? , 2009, IEEE Transactions on Haptics.

[17]  H Alm,et al.  The effects of a mobile telephone task on driver behaviour in a car following situation. , 1995, Accident; analysis and prevention.

[18]  Johan Engström,et al.  Effects of visual and cognitive load in real and simulated motorway driving , 2005 .

[19]  Peter Bengtsson,et al.  Haptic/graphic interface for in-vehicle comfort functions - a simulator study and an experimental study , 2003, The 2nd IEEE Internatioal Workshop on Haptic, Audio and Visual Environments and Their Applications, 2003. HAVE 2003. Proceedings..

[20]  Terry C Lansdown,et al.  Distraction from multiple in-vehicle secondary tasks: vehicle performance and mental workload implications , 2004, Ergonomics.

[21]  S. Lederman,et al.  Perception of texture by vision and touch: multidimensionality and intersensory integration. , 1986, Journal of experimental psychology. Human perception and performance.

[22]  R. Klatzky,et al.  Haptic exploration in the presence of vision. , 1993, Journal of experimental psychology. Human perception and performance.

[23]  Hong Z. Tan,et al.  Using spatial vibrotactile cues to direct visual attention in driving scenes , 2005 .

[24]  Jing Ren,et al.  Haptic controls in cars for making driving more safe , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[25]  Gary E. Burnett,et al.  Ubiquitous computing within cars: designing controls for non-visual use , 2001, Int. J. Hum. Comput. Stud..

[26]  J. V. Erp,et al.  Vibrotactile in-vehicle navigation system , 2004 .

[27]  A. Kappers,et al.  Haptic and visual perception of roughness. , 2007, Acta psychologica.

[28]  H S Vitense,et al.  Multimodal feedback: an assessment of performance and mental workload , 2003, Ergonomics.

[29]  Linda R. Elliott,et al.  The benefits of multimodal information: a meta-analysis comparing visual and visual-tactile feedback , 2006, ICMI '06.

[30]  David L. Strayer,et al.  Driven to Distraction: Dual-Task Studies of Simulated Driving and Conversing on a Cellular Telephone , 2001, Psychological science.

[31]  Danny Grant.  Two New Commercial Haptic Rotary Controllers , 2004 .

[32]  Toni Ivergård,et al.  Handbook of control room design and ergonomics , 1989 .

[33]  M. Heller.  Visual and tactual texture perception: Intersensory cooperation , 1982, Perception & psychophysics.

[34]  Peter Bengtsson,et al.  Haptic, visual and cross-modal perception of interface information , 2007 .

[35]  Walter W. Wierwille,et al.  DEMANDS ON DRIVER RESOURCES ASSOCIATED WITH INTRODUCING ADVANCED TECHNOLOGY INTO THE VEHICLE , 1993 .

[36]  Peter Bengtsson,et al.  Serial or parallel search with a multi-modal rotary device for in-vehicle use , 2008 .

[37]  M. Sivak.  The Information That Drivers Use: Is it Indeed 90% Visual? , 1996, Perception.

[38]  S. Lederman,et al.  Texture perception: studies of intersensory organization using a discrepancy paradigm, and visual versus tactual psychophysics. , 1981, Journal of experimental psychology. Human perception and performance.

[39]  Vincent Hayward,et al.  Haptic interfaces and devices , 2004 .

[40]  H Summala,et al.  Cognitive load and detection thresholds in car following situations: safety implications for using mobile (cellular) telephones while driving. , 1999, Accident; analysis and prevention.

[41]  C Collet,et al.  Phoning while driving II: a review of driving conditions influence , 2010, Ergonomics.

[42]  C Collet,et al.  Phoning while driving I: a review of epidemiological, psychological, behavioural and physiological studies , 2010, Ergonomics.

[43]  William S. Harwin,et al.  Interaction of Visual and Haptic Information in Simulated Environments: Texture Perception , 2000, Haptic Human-Computer Interaction.