Ifelt: accessing movies through our emotions

Films are by excellence the form of art that exploits our affective, perceptual and intellectual activity. Technological developments and the trends for media convergence are turning video into a dominant and pervasive medium and online video is becoming a growing entertainment activity on the web and iTV. The improvement of new techniques for gathering emotional information about videos, both through content analysis or user implicit feedback through user physiological signals, is revealing an unfolding of new ways for exploring emotional information in videos, films or TV series, and brings out new perspectives to personalize user information. We present iFelt - an interactive web video application to classify, access, explore and visualize movies based on their emotional characteristics. In this work, we explore the design and evaluate different ways to access, browse and visualize movies and their contents.

[1]  Mohammad Soleymani,et al.  Affective Characterization of Movie Scenes Based on Multimedia Content Analysis and User's Physiological Emotional Responses , 2008, 2008 Tenth IEEE International Symposium on Multimedia.

[2]  Teresa Chambel,et al.  VideoSpace: a 3D Video Experience , 2008 .

[3]  Alan Hanjalic,et al.  Affective video content representation and modeling , 2005, IEEE Transactions on Multimedia.

[4]  Christopher Ahlberg,et al.  Tight Coupling: Guiding User Actions in a Direct Manipulation Retrieval System , 1995, BCS HCI.

[5]  Sep Kamvar,et al.  We Feel Fine: An Almanac of Human Emotion , 2009 .

[6]  C. Metz.  Film Language: A Semiotics of the Cinema , 1974 .

[7]  P. Ekman.  Are there basic emotions? , 1992, Psychological review.

[8]  M. Oaksford,et al.  Emotional cognition: from brain to behaviour , 2002 .

[9]  Teresa Chambel,et al.  Context perception in video-based hypermedia spaces , 2002, HYPERTEXT '02.

[10]  Harry W. Agius,et al.  Analysing user physiological responses for affective video summarisation , 2009, Displays.

[11]  Teresa Chambel,et al.  ColorsInMotion: interactive visualization and exploration of video spaces , 2009, MindTrek '09.

[12]  Mohammad Soleymani,et al.  Affective Characterization of Movie Scenes Based on Content Analysis and Physiological Changes , 2009, Int. J. Semantic Comput..

[13]  Sylvia D. Kreibig,et al.  Cardiovascular, electrodermal, and respiratory response patterns to fear- and sadness-inducing films. , 2007, Psychophysiology.

[14]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[15]  Martha Larson,et al.  Enhanced Multimedia Content Access and Exploitation Using Semantic Speech Retrieval , 2009, 2009 IEEE International Conference on Semantic Computing.

[16]  Sung-Bae Cho,et al.  Video scene retrieval with interactive genetic algorithm , 2007, Multimedia Tools and Applications.

[17]  Frederic P. Miller,et al.  Internet Movie Database , 2009 .

[18]  A. Damasio,et al.  Basic emotions are associated with distinct patterns of cardiorespiratory activity. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[19]  Marcel Worring,et al.  The Role of Visual Content and Style for Concert Video Indexing , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[20]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  D. Arijon,et al.  Grammar of Film Language , 1976 .

[22]  David M. Nichols,et al.  How people find videos , 2008, JCDL '08.

[23]  Eva Oliveira,et al.  VIRUS: video information retrieval using subtitles , 2010, MindTrek.

[24]  Alexander G. Hauptmann.  Lessons for the Future from a Decade of Informedia Video Analysis Research , 2005, CIVR.

[25]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Raymond Spottiswoode,et al.  A grammar of the film , 1950 .

[27]  R. Plutchik.  Emotion, a psychoevolutionary synthesis , 1980 .

[28]  Vivian V. Valentin,et al.  The effects of positive affect and arousal and working memory and executive attention: Neurobiology and computational models. , 2002 .

[29]  K. Scherer.  What are emotions? And how can they be measured? , 2005 .

[30]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[31]  John J. B. Allen,et al.  The handbook of emotion elicitation and assessment , 2007 .

[32]  Michael D. Robinson,et al.  Measures of emotion: A review , 2009, Cognition & emotion.

[33]  Ben Shneiderman,et al.  Tree visualization with tree-maps: 2-d space-filling approach , 1992, TOGS.

[34]  Alain Pruski,et al.  Emotion recognition for human-machine communication , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[35]  Jesse S. Jin,et al.  Personalized video adaptation based on video content analysis , 2008, MDM '08.