How does audio-haptic enhancement influence emotional response to mobile media?

This research sought to characterize and quantify the emotional response to haptic (vibrotactile) enhancement in mobile video applications, and its impact on quality of experience. The findings reported here indicate that participants feel more emotionally involved with certain types of mobile video content when they are accompanied by haptic effects generated from the audio track. Study participants also exhibited heightened emotional arousal levels as indicated by both a physiological measure (electrodermal response rates) and a self-report. These results have important implications for mobile interaction designers, as well as mobile content providers and application developers, who wish to create engaging media experiences for mobile device users.

[1]  Kimberly A. Neuendorf,et al.  The Content Analysis Guidebook , 2001 .

[2]  Michel Tuan Pham,et al.  When Arousal Influences Ad Evaluation and Valence Does Not (and Vice Versa) , 2001 .

[3]  F. Kardes,et al.  The Effects of Physiological Arousal on Information Processing and Persuasion , 1988 .

[4]  Anatole Lécuyer,et al.  Enhancing Audiovisual Experience with Haptic Feedback: A Survey on HAV , 2013, IEEE Transactions on Haptics.

[5]  G. A. Mendelsohn,et al.  Affect grid : A single-item scale of pleasure and arousal , 1989 .

[6]  W. Wells.  Three Useful Ideas , 1986 .

[7]  Seung-Chan Kim,et al.  Surround haptics: tactile feedback for immersive gaming experiences , 2012, CHI Extended Abstracts.

[8]  Anatole Lécuyer,et al.  Framework for enhancing video viewing experience with haptic effects of motion , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[9]  Vassil N. Alexandrov,et al.  Using Haptics to Improve Immersion in Virtual Environments , 2006, International Conference on Computational Science.

[10]  Hendrik Müller,et al.  Understanding tablet use: a multi-method exploration , 2012, Mobile HCI.

[11]  John Kenneth Salisbury,et al.  Haptically Annotated Movies: Reaching Out and Touching the Silver Screen , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[12]  Roope Raisamo,et al.  Emotional and behavioral responses to haptic stimulation , 2008, CHI.

[13]  R. Petty,et al.  The elaboration likelihood model , 2012 .

[14]  Miriam Reiner,et al.  The role of haptics in immersive telecommunication environments , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Abdulmotaleb El-Saddik,et al.  Adding haptic feature to YouTube , 2010, ACM Multimedia.

[16]  Ian Oakley,et al.  A tactile glove design and authoring system for immersive multimedia , 2010, IEEE MultiMedia.

[17]  J. Cacioppo,et al.  Handbook Of Psychophysiology , 2019 .