Video Analysis Based on Mutual Information

In this paper we present the methods used for the analysis of video based on mutual information. We propose a novel method of abrupt cut detection and a novel objective method for measuring the quality of video. In the field of abrupt cut detection we improve the existing method based on mutual information. The novelty of our method is in combining the motion prediction and the mutual information. Our approach provides higher robustness to object and camera motion. According to the objective method for measuring the quality of video, it is based on calculation the mutual information between the frame from the original sequence and the corresponding frame from the test sequence. We compare results of the proposed method with commonly used objective methods for measuring the video quality. Results show that our method correlates with the standardized method and the distance metric, so it is possible to replace a more complex method with our simpler method.

[1]  Rainer Lienhart,et al.  Comparison of automatic shot boundary detection algorithms , 1998, Electronic Imaging.

[2]  Markus Rupp,et al.  Video Quality Estimation for Mobile H.264/AVC Video Streaming , 2008, J. Commun..

[3]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, Electronic Imaging.

[4]  Zhao Huan,et al.  Shot Boundary Detection Based on Mutual Information and Canny Edge Detector , 2008, 2008 International Conference on Computer Science and Software Engineering.

[5]  Mahmood Fathy,et al.  Video Shot Boundary Detection Using QR-Decomposition and Gaussian Transition Detection , 2010, EURASIP J. Adv. Signal Process..

[6]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[7]  Yuukou Horita,et al.  NR objective continuous video quality assessment model based on frame quality measure , 2008, 2008 15th IEEE International Conference on Image Processing.

[8]  R. Dosselmann,et al.  A Formal Assessment of the Structural Similarity Index , 2008 .

[9]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[10]  Yubing Wang,et al.  Survey of Objective Video Quality Measurements , 2006 .

[11]  Jeho Nam,et al.  Detection of gradual transitions in video sequences using B-spline interpolation , 2005, IEEE Transactions on Multimedia.

[12]  Stefan Winkler,et al.  Digital Video Quality: Vision Models and Metrics , 2005 .