A Graph-Based Approach and Analysis Framework for Hierarchical Browsing of Video Content

Systems for multimedia retrieval have been object of scientific research for many years. When it comes to present results to the user many solutions disregard the set of problems connected to content delivery. Especially time-constrained results of video retrieval systems need a different visualization. In this paper we present our solution for hierarchical content browsing of video files. Our workflow covers the phases of ingest, transcoding, automatic analysis, intellectual annotation and data aggregation. We describe an algorithm for the graph-based analysis of the content structure in videos. By identifying the requirements of professional users we developed a user interface enabling to access retrieval results in different hierarchical abstraction levels.

[1]  Maximilian Eibl,et al.  Evaluation of media analysis and information retrieval solutions for audio-visual content through their integration in realistic workflows of the broadcast industry , 2013, RACS.

[2]  Stephan Heinich Textdetektion und -extraktion mit gewichteter DCT und mehrwertiger Bildzerlegung , 2009 .

[3]  Arne Berger,et al.  Visual String of Reformulation , 2009, HCI.

[4]  Boon-Lock Yeo,et al.  Time-constrained clustering for segmentation of video into story units , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[5]  Helmut Korte Einführung in die Systematische Filmanalyse : ein Arbeitsbuch : mit Beispielanalysen von Peter Drexler, ... zu Zabriskie point (Antonioni 1969), Misery (Reiner 1990), Schindlers Liste (Spielberg 1993), Romeo und Julia (Luhrmann 1996) , 1999 .

[6]  Wen Gao,et al.  Automatic Segmentation of News Items Based on Video and Audio Features , 2001, IEEE Pacific Rim Conference on Multimedia.

[7]  Marc Cavazza,et al.  Interactive storytelling via video content recombination , 2010, ACM Multimedia.

[8]  Yong-Moo Kwon,et al.  A new approach for high level video structuring , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[9]  Alan Hanjalic,et al.  Automated high-level movie segmentation for advanced video-retrieval systems , 1999, IEEE Trans. Circuits Syst. Video Technol..

[10]  Arne Berger,et al.  Produce. annotate. archive. repurpose --: accelerating the composition and metadata accumulation of tv content , 2011, AIEMPro '11.

[11]  Michael Storz,et al.  A Support Framework for Automated Video and Multimedia Workflows for Production and Archive , 2013, HCI.

[12]  Marcel Worring,et al.  Systematic evaluation of logical story unit segmentation , 2002, IEEE Trans. Multim..

[13]  Bo Xu,et al.  Graph-based multi-modal scene detection for movie and teleplay , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Maximilian Eibl,et al.  A proposal for a taxonomy of semantic editing devices to support semantic classification , 2014, RACS '14.

[15]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Riccardo Leonardi,et al.  An overview of video shot clustering and summarization techniques for mobile applications , 2006, MobiMedia '06.

[17]  Yiannis Kompatsiaris,et al.  Multi-modal scene segmentation using scene transition graphs , 2009, ACM Multimedia.

[18]  Chong-Wah Ngo,et al.  Video summarization and scene detection by graph modeling , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  László Böszörményi,et al.  State-of-the-art and future challenges in video scene detection: a survey , 2013, Multimedia Systems.

[20]  Marc Ritter Optimierung von Algorithmen zur Videoanalyse , 2013 .

[21]  Lie Lu,et al.  Speaker change detection and tracking in real-time news broadcasting analysis , 2002, MULTIMEDIA '02.

[22]  Maximilian Eibl,et al.  An Extensible Tool for the Annotation of Videos Using Segmentation and Tracking , 2011, HCI.