A Novel Video Parsing Algorithm Utilizing the Pleasure-Arousal-Dominance Emotional Information

One of the major problems faced when designing a high level video parsing system is that viewers usually have doubts about the exact boundaries of an episode. Moreover, due to the different emotional states that viewers have while viewing a video, it is very difficult to improve the performance of these algorithms using convention methods. To solve this problem, this paper presents a novel spectral clustering based high level video parsing algorithm that utilizes the Pleasure-Arousal-Dominance (P-A-D) (Mehrabian, 1996 and Valdez and Mehrabian, 1994) emotional content of the video.

[1]  A. Mehrabian.  Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in Temperament , 1996 .

[2]  Alan Hanjalic,et al.  Affective video content representation and modeling , 2005, IEEE Transactions on Multimedia.

[3]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[4]  Marcel Worring,et al.  Systematic evaluation of logical story unit segmentation , 2002, IEEE Trans. Multim..

[5]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[6]  Rainer Lienhart,et al.  Scene Determination Based on Video and Audio Features , 2004, Multimedia Tools and Applications.

[7]  P. Valdez,et al.  Effects of color on emotions. , 1994, Journal of experimental psychology. General.

[8]  Wolfgang Effelsberg,et al.  Scene Determination Based on Video and Audio Features , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[9]  John R. Kender,et al.  Video scene segmentation via continuous video coherence , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[10]  Alan Hanjalic,et al.  Automated high-level movie segmentation for advanced video-retrieval systems , 1999, IEEE Trans. Circuits Syst. Video Technol..