Mood Glove: A haptic wearable prototype system to enhance mood music in film

Abstract This is an exploratory work aimed at enhancing mood music in film entertainment. We present the design and implementation of a haptic wearable prototype system which aims to amplify mood music in film through haptic sensations (vibrotactile feedback). This approach also could potentially have implications for hearing-impaired audiences, providing a new enriched emotional experience while watching a movie. This paper reports on a set of three studies conducted to assess whether vibrotactile stimuli are able to enhance moods. Preliminary findings show that vibrotacile stimuli at low intensity and low frequency induce a sense of calmness in users, whereas vibrotactile stimuli at low intensity but higher frequency increased excitement. The combination of high intensity and high frequency vibrotactile stimuli heightened tension on the other hand. These findings support our position that vibrotactile feedback could be used to enrich the emotional aspects of cinematic experience through haptic sensations.

[1]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[2]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[3]  Mike Graham,et al.  Extracting information about emotions in films , 2003, ACM Multimedia.

[4]  Alan Hanjalic,et al.  Affective video content representation and modeling , 2005, IEEE Transactions on Multimedia.

[5]  A. Hanjalic,et al.  Extracting moods from pictures and sounds: towards truly personalized TV , 2006, IEEE Signal Processing Magazine.

[6]  Deborah I. Fels,et al.  Modelling Perceptual Elements of Music in a Vibrotactile Display for Deaf Users: A Field Study , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[7]  Mary S. Binseel,et al.  The Tactile Modality: A Review of Tactile Sensitivity and Human Tactile Interfaces , 2007 .

[8]  Elaine Chew,et al.  Quantitative and visual analysis of the impact of music on perceived emotion of film , 2007, CIE.

[9]  James Monaco,et al.  How to read a film : movies, media, and beyond : art, technology, language, history, theory , 2009 .

[10]  Hussein Al Osman,et al.  Affective Haptics: Current Research and Future Directions , 2016, IEEE Access.

[11]  P. Lang.  Behavioral treatment and bio-behavioral assessment: computer applications , 1980 .

[12]  Paul Lemmens,et al.  A body-conforming tactile jacket to enrich movie viewing , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[13]  Min Xu,et al.  Affective content analysis in comedy and horror videos by audio emotional event detection , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[14]  Ali Israr,et al.  Feel effects: enriching storytelling with haptic feedback , 2014 .

[15]  Shikha Jhingan.  Film Music: , 2021, Nature.

[16]  Seungmoon Choi,et al.  Emotional responses of tactile icons: Effects of amplitude, frequency, duration, and envelope , 2015, 2015 IEEE World Haptics Conference (WHC).

[17]  Mohammad Soleymani,et al.  Affective ranking of movie scenes using physiological signals and content analysis , 2008, MS '08.

[18]  Mohammad Soleymani,et al.  Corpus Development for Affective Video Indexing , 2012, IEEE Transactions on Multimedia.

[19]  David Bordwell,et al.  Film Art: An Introduction , 1979 .

[20]  A. Schaefer,et al.  Please Scroll down for Article Cognition & Emotion Assessing the Effectiveness of a Large Database of Emotion-eliciting Films: a New Tool for Emotion Researchers , 2022 .

[21]  Gareth J. F. Jones,et al.  Affect-based indexing and retrieval of films , 2005, MULTIMEDIA '05.

[22]  Lynne E. Bernstein,et al.  OMAR a haptic display for speech perception by deaf and deaf-blind individuals , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[23]  Deborah I. Fels,et al.  Towards a model human cochlea: sensory substitution for crossmodal audio-tactile displays , 2008, Graphics Interface.

[24]  Suranga Nanayakkara,et al.  An enhanced musical experience for the deaf: design and evaluation of a music display and a haptic chair , 2009, CHI.

[25]  Nick Bryan-Kinns,et al.  Identifying mutual engagement , 2012, Behav. Inf. Technol..

[26]  Nick Bryan-Kinns,et al.  How does it feel like? An exploratory study of a prototype system to convey emotion through haptic wearable devices , 2015, 2015 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN).

[27]  Marcelo M. Wanderley,et al.  Perceptual Characterization of a Tactile Display for a Live-Electronics Notification System , 2014, ICMC.

[28]  Ó. Gonçalves,et al.  The Emotional Movie Database (EMDB): A Self-Report and Psychophysiological Study , 2012, Applied psychophysiology and biofeedback.