An adaptive shot change detection algorithm and its implementation on portable multimedia player

Shot change detection is a main technique for automatic temporal segmentation of video, which requires adaptive adjustment of thresholds and real-time operation in actual applications. To date, few researches have been conducted on real-time shot change detection to be applied to hardware terminals with low performance such as PMPs (portable media player) and cellular phones. In this paper, we propose an adaptive real-time shot change detection algorithm and implement it on an actual PMP. The proposed algorithm consists of the following elements: sub-sampling, weighting variance, and adaptive thresholds. Our experiments obtained the detection rate of about 94.4% in overall accuracy, demonstrating a higher detection rate and a computational amount 1/256 less than the conventional algorithms which have optimal fixed thresholds adjusted by humans for each video. We verified the real-time operation of shot change detection by implementing our algorithm on the PMP of Homecast, a PMP company. The proposed algorithm will be helpful in searching video data on portable media players such as PMPs and cellular phones.

[1]  Behzad Shahraray,et al.  Scene change detection and content-based sampling of video sequences , 1995, Electronic Imaging.

[2]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[3]  Ramesh C. Jain,et al.  Digital video segmentation , 1994, MULTIMEDIA '94.

[4]  Tae-Sun Choi,et al.  A hard disk drive embedded digital satellite receiver with scene change detector for video indexing , 2002, IEEE Trans. Consumer Electron..

[5]  Nilesh V. Patel,et al.  Statistical approach to scene change detection , 1995, Electronic Imaging.

[6]  Jing Xiao,et al.  Content-Based Video Indexing and Retrieval , 2004 .

[7]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[8]  Sungjoo Suh,et al.  Fast scene change detection for personal video recorder , 2003, 2003 IEEE International Conference on Consumer Electronics, 2003. ICCE..

[9]  Jun Yu,et al.  An efficient method for scene cut detection , 2001, Pattern Recognit. Lett..

[10]  A. Baskar,et al.  Improved Adaptive Skip Algorithm for Video Shot Boundary Detection , 2007, 2007 International Conference on Signal Processing, Communications and Networking.

[11]  Ullas Gargi,et al.  Evaluation of video sequence indexing and hierarchical video indexing , 1995, Electronic Imaging.

[12]  F. Arman,et al.  A Statistical Approach to Scene Change Detection , 1995 .

[13]  José Manuel Menéndez,et al.  A unified model for techniques on video-shot transition detection , 2005, IEEE Transactions on Multimedia.

[14]  Wei Xiong,et al.  Automatic and dynamic video manipulation , 1999 .

[15]  N. Nikolaidis,et al.  Video shot detection and condensed representation. a review , 2006, IEEE Signal Processing Magazine.

[16]  Takafumi Miyatake,et al.  IMPACT: an interactive natural-motion-picture dedicated multimedia authoring system , 1991, CHI.

[17]  José Manuel Menéndez,et al.  Multidimensional comparison of shot detection algorithms , 2002, Proceedings. International Conference on Image Processing.

[18]  Yoshinobu Tonomura,et al.  Video handling based on structured information for hypermedia systems , 1991 .

[19]  David Bull,et al.  Scene change detection algorithms for content-based video indexing and retrieval , 2001 .

[20]  Wei Xiong,et al.  Net comparison: an adaptive and effective method for scene change detection , 1995 .

[21]  Xu De,et al.  A method for shot boundary detection with automatic threshold , 2002, 2002 IEEE Region 10 Conference on Computers, Communications, Control and Power Engineering. TENCOM '02. Proceedings..

[22]  Kien A. Hua,et al.  Detecting video shot boundaries up to 16 times faster (poster session) , 2000, ACM Multimedia.

[23]  Angelo Chianese,et al.  Foveated shot detection for video segmentation , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[25]  Seong-Yoon Shin,et al.  A Scene Change Detection Scheme Using Local x^2-Test on Telematics , 2006, 2006 International Conference on Hybrid Information Technology.

[26]  Shih-Fu Chang,et al.  Scene change detection in an MPEG-compressed video sequence , 1995, Electronic Imaging.

[27]  Ullas Gargi,et al.  Performance characterization of video-shot-change detection methods , 2000, IEEE Trans. Circuits Syst. Video Technol..

[28]  Lee Yang-Won,et al.  Video Segmentation using the Automated Threshold Decision Algorithm , 2005 .