Compressed-Domain Shot Boundary Detection for H.264/AVC Using Intra Partitioning Maps

In this paper, a novel technique for shot boundary detection operating on H.264/AVC-compressed sequences is presented. Due to new and improved coding tools in H.264/AVC, the characteristics of the obtained sequences differ from former video coding standards. Although several algorithms working on this new standard are already proposed, the presence of IDR frames can still lead to a low accuracy for abrupt transitions. To solve this issue, we present the motion-compensated intra partitioning map which relies on the intra partitioning modes and the motion vectors present in the compressed video stream. Experimental results show that this motion-compensated map achieves a high accuracy and exceeds related work.

[1]  Jesús Bescós,et al.  Real-time shot change detection over online MPEG-2 video , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[3]  Otthein Herzog,et al.  Automatic Shot Boundary Detection Combining Color, Edge, and Motion Features of Adjacent Frames , 2004, TRECVID.

[4]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[5]  Warnakulasuriya Anil Chandana Fernando,et al.  Sudden scene change detection in compressed video using interpolated macroblocks in B-frames , 2006, Multimedia Tools and Applications.

[6]  Van de WalleRik,et al.  A compressed-domain approach for shot boundary detection on H.264/AVC bit streams , 2008 .

[7]  Wen Gao,et al.  Shot change detection on H.264/AVC compressed video , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[8]  Soo-Chang Pei,et al.  Efficient MPEG Compressed Video Analysis Using Macroblock Type Information , 1999, IEEE Trans. Multim..

[9]  Remi Depommier,et al.  Content-based browsing of video sequences , 1994, MULTIMEDIA '94.

[10]  Yo-Sung Ho,et al.  Advances in Multimedia Information Processing - PCM 2005, 6th Pacific-Rim Conference on Multimedia, Jeju Island, Korea, November 13-16, 2005, Proceedings, Part I , 2005, PCM.

[11]  Wen Gao,et al.  A novel compressed domain shot segmentation algorithm on H.264/AVC , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[12]  Wesley De Neve,et al.  A compressed-domain approach for shot boundary detection on H.264/AVC bit streams , 2008, Signal Process. Image Commun..

[13]  Alan Hanjalic.  Towards Theoretical Performance Limits of Video Parsing , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Sung Kim,et al.  A Scene Change Detection in H.264/AVC Compression Domain , 2005, PCM.

[15]  Tien-Ying Kuo,et al.  Detection of H.264 Shot Change Using Intra Predicted Direction , 2008, 2008 International Conference on Intelligent Information Hiding and Multimedia Signal Processing.