Measuring the added value of haptic feedback

While there is an increased appreciation for integrating haptic feedback with audio-visual content, there is still a lack of understanding of how to quantify the added value of touch for a user's experience (UX) of multimedia content. Here we focus on three main concepts to measure this added value: UX, emotions, and expectations. We present a case study measuring the added value of haptic feedback for a standardized set of audio-visual content (i.e., short video clips), comparing two haptic stimulation modalities (i.e., mid-air vs. vibro-tactile stimuli). Our findings demonstrate that UX of haptically-enhanced audio-visual content is perceived as a more pleasant, unpredictable, and creative experience. The users' overall liking increases together with a positive change of the users' expectations, independently from the haptic stimulation modality. We discuss how our approach provides the foundation for future work on developing a measurement model to predict the added value of haptic feedback for users' experiences within and beyond the multimedia context.

[1]  Marc Hassenzahl,et al.  The Inference of Perceived Usability From Beauty , 2010, Hum. Comput. Interact..

[2]  I. Ajzen,et al.  Predicting and Changing Behavior: The Reasoned Action Approach , 2009 .

[3]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[4]  P. Ekman,et al.  Emotion and autonomic nervous system activity in the Minangkabau of west Sumatra. , 1992, Journal of personality and social psychology.

[5]  Karon E. MacLean,et al.  Improvising design with a Haptic Instrument , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[6]  Sriram Subramanian,et al.  Emotions Mediated Through Mid-Air Haptics , 2015, CHI.

[7]  Virpi Roto,et al.  Understanding, scoping and defining user experience: a survey approach , 2009, CHI.

[8]  P. Lang.  The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[9]  Marc Hassenzahl,et al.  From mental effort to perceived usability: transforming experiences into summary assessments , 2004, CHI EA '04.

[10]  D. Keltner,et al.  The communication of emotion via touch. , 2009, Emotion.

[11]  J. Russell,et al.  Independence and bipolarity in the structure of current affect. , 1998 .

[12]  Marc Hassenzahl,et al.  MARC HASSENZAHL CHAPTER 3 The Thing and I: Understanding the Relationship Between User and Product , 2003 .

[13]  Regan L. Mandryk,et al.  Using psychophysiological techniques to measure user experience with entertainment technologies , 2006, Behav. Inf. Technol..

[14]  Ali Israr,et al.  Feel Effects , 2014, ACM Trans. Appl. Percept..

[15]  Jan Noyes.  Expectations and Their Forgotten Role in HCI , 2006 .

[16]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[17]  Eyal Ofek,et al.  Haptic Retargeting Video Showcase: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experience , 2016, CHI Extended Abstracts.

[18]  P. Lang.  International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[19]  Abdulmotaleb El-Saddik,et al.  Toward a Mathematical Model for Quality of Experience Evaluation of Haptic Applications , 2013, IEEE Transactions on Instrumentation and Measurement.

[20]  Evangelos Karapanos,et al.  Modeling Users' Experiences with Interactive Systems , 2012, Studies in Computational Intelligence.

[21]  Katrien De Moor,et al.  Quality of Experience Versus User Experience , 2014, Quality of Experience.

[22]  Cristina Hava Muntean,et al.  User-centered EEG-based multimedia quality assessment , 2013, 2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[23]  Sarah Diefenbach,et al.  Needs, affect, and interactive products - Facets of user experience , 2010, Interact. Comput..

[24]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.