Evaluation of logical story unit segmentation in video sequences

We present results of an evaluation of several existing Logical Story Unit segmentation methods based on film theory. Three types of methods known from video processing literature were evaluated. An unprecedented amount of 8 hours for 6 different videos were used to evaluate the methods under the same circumstances so that an unbiased judgement is presented. As Logical Story Units cannot be defined with full certainty, a new evaluation method is introduced measuring the economic impact of results. Experiments show reasonable performance for all methods. Time constrained clustering is the most effective and consistent method.

[1]  Boon-Lock Yeo,et al.  Time-constrained clustering for segmentation of video into story units , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[2]  R. Brunelli,et al.  A Survey on the Automatic Indexing of Video Data, , 1999, J. Vis. Commun. Image Represent..

[3]  Donald A. Adjeroh,et al.  A Distance Measure for Video Sequences , 1999, Comput. Vis. Image Underst..

[4]  Marcel Worring,et al.  Evaluation measurement for Logical Story Unit segmentation in video sequences , 2001 .

[5]  Wolfgang Effelsberg,et al.  Scene Determination Based on Video and Audio Features , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[6]  Alan Hanjalic,et al.  Automatically Segmenting Movies into Logical Story Units , 1999, VISUAL.

[7]  John R. Kender,et al.  Video scene segmentation via continuous video coherence , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[8]  Yong-Moo Kwon,et al.  A new approach for high level video structuring , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[9]  Suh-Yin Lee,et al.  Automatic Video Summary and Description , 2000, VISUAL.

[10]  Thomas S. Huang,et al.  Constructing table-of-content for videos , 1999, Multimedia Systems.

[11]  Joseph M. Boggs.  The Art of Watching Films , 1978 .