Relative Flow Estimates for Shot Boundary Detection

This paper proposes a simple approach based on Relative Flow Estimates (RFE) for shot cut detection. The property of Relative flow estimates can be used for abrupt cut detection and a correction mechanism for gradual camera-shot transition detection (e.g., fade-in and fade-out, dissolves, wipes). The exacted feature vector in each frame can be mapped into a 3-D space along the continuous time axis, and these feature data can be treated as a virtually constructed pipe with fluid flowing in the 3-D axis. Compared with existing approaches, the new RFE-based algorithm can directly detect shot cut. A wide range of test videos are used to evaluate the performance of the proposed method. The experimental results show that the new scheme can produce promising results.

[1]  Ramin Zabih,et al.  Histogram refinement for content-based image retrieval , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[2]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[3]  B. S. Manjunath,et al.  A texture descriptor for browsing and similarity retrieval , 2000, Signal Process. Image Commun..

[4]  King Ngi Ngan,et al.  Integrated shot boundary detection using object-based technique , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[5]  Ting Liu,et al.  Video Segmentation via Temporal Pattern Classification , 2007, IEEE Transactions on Multimedia.

[6]  Ba Tu Truong,et al.  Scene extraction in motion pictures , 2003, IEEE Trans. Circuits Syst. Video Technol..

[7]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[8]  Jian Feng,et al.  Inertia-based cut detection technique: a step to the integration of video coding and content-based retrieval , 2000, WCC 2000 - ICSP 2000. 2000 5th International Conference on Signal Processing Proceedings. 16th World Computer Congress 2000.

[9]  Kosin Chamnongthai,et al.  A study of discriminant visual descriptors for sport video shot boundary detection , 2015, 2015 10th Asian Control Conference (ASCC).

[10]  Yue Guan,et al.  Shot boundary detection with sparse presentation , 2016, 2016 IEEE 13th International Conference on Signal Processing (ICSP).

[11]  Sarp Ertürk,et al.  Modified phase-correlation based robust hard-cut detection with application to archive film , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Patrick Bouthemy,et al.  A unified approach to shot change detection and camera motion characterization , 1999, IEEE Trans. Circuits Syst. Video Technol..

[13]  K. P. Uma,et al.  Shot boundary detection using correlation based spectral residual saliency map , 2016, 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[14]  S. Domnic,et al.  Walsh–Hadamard Transform Kernel-Based Feature Vector for Shot Boundary Detection , 2014, IEEE Transactions on Image Processing.

[15]  Seong-Whan Lee,et al.  Automatic video parsing using shot boundary detection and camera operation analysis , 2001, Pattern Recognit..

[16]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Shih-Fu Chang,et al.  Transform features for texture classification and discrimination in large image databases , 1994, Proceedings of 1st International Conference on Image Processing.

[18]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[19]  Junyu Dong,et al.  Image retrieval using wavelet-based salient regions , 2011 .

[20]  Nam Ik Cho,et al.  A static video summarization method based on the sparse coding of features and representativeness of frames , 2017, EURASIP J. Image Video Process..

[21]  Nicole Vincent,et al.  A review of real-time segmentation of uncompressed video sequences for content-based search and retrieval , 2003, Real Time Imaging.

[22]  Shang-Hong Lai,et al.  Integrated video shot segmentation algorithm , 2003, IS&T/SPIE Electronic Imaging.

[23]  Nilesh V. Patel,et al.  Statistical approach to scene change detection , 1995, Electronic Imaging.

[24]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Bo Zhang,et al.  A Formal Study of Shot Boundary Detection , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Junyu Dong,et al.  Intergrating Salient Regions with New Perceptual Texture Features Based on Wavelet Transform for Image Retrieval , 2009, J. Softw..