Dynamic social network for narrative video analysis

Narrative video analysis has attracted much research attention, for narrative scenes can provide meaningful representations of multimedia contents. To go beyond the limitations of content based appraoches, social network techniques was introduced in the literature to explore the high-level narrative structures by mining the relations between video characters. Taking into account the fact that such a social network is not static but changes over time as the video narrative evolves, in this work, we develop a novel social network model, namely dynamic social network, for capturing the spatiotemporal dynamics in the social network of video characters so as to enable the automatic segmentation of a video into a sequence of narrative scenes. The proposed approach is experimented with various genres of movies and the results demonstrate our effectiveness.

[1]  C. Vogler,et al.  The Writer's Journey: Mythic Structure for Writers , 2007 .

[2]  Shuicheng Yan,et al.  Cast2Face: character identification in movie with actor-character correspondence , 2010, ACM Multimedia.

[3]  Ana Respício,et al.  Representing and playing user selected video narrative domains , 2008, SRMC '08.

[4]  Andreas Girgensohn,et al.  Temporal event clustering for digital photo collections , 2005, ACM Trans. Multim. Comput. Commun. Appl..

[5]  Wen-Huang Cheng,et al.  Film Narrative Exploration Through the Analysis of Aesthetic Elements , 2007, MMM.

[6]  Kiyoharu Aizawa,et al.  Automatic trailer generation , 2010, ACM Multimedia.

[7]  Wei-Ta Chu,et al.  Action movies segmentation and summarization based on tempo analysis , 2004, MIR '04.

[8]  Mubarak Shah,et al.  Automatic Segmentation of Home Videos , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[9]  Jhing-Fa Wang,et al.  A Novel Video Summarization Based on Mining the Story-Structure and Semantic Relations Among Concept Entities , 2009, IEEE Transactions on Multimedia.

[10]  Ming-Syan Chen,et al.  Sliding-window filtering: an efficient algorithm for incremental mining , 2001, CIKM '01.

[11]  Xindong Wu,et al.  Sequential association mining for video summarization , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[12]  Changsheng Xu,et al.  Character Identification in Feature-Length Films Using Global Face-Name Matching , 2009, IEEE Transactions on Multimedia.

[13]  Wei-Ta Chu,et al.  RoleNet: Movie Analysis from the Perspective of Social Networks , 2009, IEEE Transactions on Multimedia.