Video shot boundary detection using motion activity descriptor

Abstract —This paper focus on the study of the motion activity descriptor for shot boundary detection in video sequences. We interest in the validation of this descriptor in the aim of its real time implementation with reasonable high performances in shot boundary detection. The motion activity information is extracted in uncompressed domain based on adaptive rood pattern search (ARPS) algorithm. In this context, the motion activity descriptor was applied for different video sequence. Index Terms —Motion activity, MPEG-7, video segmentation, ARPS, Block-matching. —————————— —————————— 1. I NTRODUCTION n recent years, the development of software and hardware technology has enabled the creation of a large amount of digital video content. Video segmentation based on motion [1] is a new research area. Motion is a salient feature in video, in addition to other typical image features such as color, shape and texture. Video shot boundary detection is a fundamental step in video indexing and retrieval, and in general video data management. The general objectives are to segment a given video sequence into its constituent shots, and to identify and classify the different shot transitions in the sequence [10]. Different algorithms have been proposed, for instance, based on simple color histograms [11, 12], pixel color differences [13], color ratio histograms [14], edges [15], and motion [16– 18]. In this work, we study the problem of video partitioning using a motion-based approach. In this study we interest in the validation of the motion activity descriptor in the aim of its possible real time implementation. We have applied this descriptor for different video sequence. We have considered its application for shot boundary detection. The rest of this paper is organized as follows: in section 2, we present the motion activity descriptor specification. In section 3 we focus on the study of the motion activity descriptor for shot boundary detection in video sequences. The different experimentations and the evolution results of the motion activity are presented in section 4.

[1]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[2]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[3]  A. Murat Tekalp,et al.  Automatic soccer video analysis and summarization , 2003, IEEE Trans. Image Process..

[4]  Patrick Bouthemy,et al.  A unified approach to shot change detection and camera motion characterization , 1999, IEEE Trans. Circuits Syst. Video Technol..

[5]  B. S. Manjunath,et al.  A Motion Activity Descriptor and Its Extraction in Compressed Domain , 2001, IEEE Pacific Rim Conference on Multimedia.

[6]  Ajay Divakaran,et al.  MPEG-7 visual motion descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[7]  Jonathan D. Courtney Automatic video indexing via object motion analysis , 1997, Pattern Recognit..

[8]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[9]  Aroh Barjatya,et al.  Block Matching Algorithms For Motion Estimation , 2004 .

[10]  K. Iinuma,et al.  Television bandwidth compression transmission by motion-compensated interframe coding , 1982, IEEE Communications Magazine.

[11]  A. Murat Tekalp,et al.  Two-stage hierarchical video summary extraction to match low-level user browsing preferences , 2003, IEEE Trans. Multim..

[12]  Donald A. Adjeroh,et al.  Adaptive Edge-Oriented Shot Boundary Detection , 2009, EURASIP J. Image Video Process..

[13]  Kai-Kuang Ma,et al.  Adaptive rood pattern search for fast block-matching motion estimation , 2002, IEEE Trans. Image Process..

[14]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying production effects , 1999, Multimedia Systems.

[15]  Werner Bailer,et al.  Deliverable D15.3 Mds3 State of the Art of Content Analysis Tools for Video, Audio and Speech , 2022 .

[16]  Donald A. Adjeroh,et al.  Robust and Efficient Transform Domain Video Sequence Analysis: An Approach from the Generalized Color Ratio Model , 1997, J. Vis. Commun. Image Represent..

[17]  Rangasami L. Kashyap,et al.  Models for motion-based video indexing and retrieval , 2000, IEEE Trans. Image Process..