Slow Motion and Zoom in HD Digital Videos Using Fractals

Slow motion replay and spatial zooming are special effects used in digital video rendering. At present, most techniques to perform digital spatial zoom and slow motion are based on interpolation for both enlarging the size of the original pictures and generating additional intermediate frames. Mainly, interpolation is done either by linear or cubic spline functions or by motion estimation/compensation which both can be applied pixel by pixel, or by partitioning frames into blocks. Purpose of this paper is to present an alternative technique combining fractals theory and wavelet decomposition to achieve spatial zoom and slow motion replay of HD digital color video sequences. Fast scene change detection, active scene detection, wavelet subband analysis, and color fractal coding based on Earth Mover's Distance (EMD) measure are used to reduce computational load and to improve visual quality. Experiments show that the proposed scheme achieves better results in terms of overall visual quality compared to the state-of-the-art techniques.

[1]  Fred Daneshgaran,et al.  Special Issue on Iterative Decoding and Cross-Layering Techniques for Multimedia Broadcasting and Communications per la rivista International Journal of Digital Multimedia Broadcasting , 2008 .

[2]  Mohammed E. Al-Mualla.  Motion field interpolation for frame rate conversion , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[3]  A. Murat Tekalp,et al.  Automatic soccer video analysis and summarization , 2003, IEEE Trans. Image Process..

[4]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  E. Polidori.  Zooming using iterated function systems , 1997 .

[6]  Bernd Huertgen,et al.  Fractal transform coding of color images , 1994, Other Conferences.

[7]  Ying Zhang,et al.  Fractal color image compression using vector distortion measure , 1995, Proceedings., International Conference on Image Processing.

[8]  Arnaud E. Jacquin,et al.  Image coding based on a fractal theory of iterated contractive image transformations , 1992, IEEE Trans. Image Process..

[9]  S. Wolf.  Measuring the end-to-end performance of digital video systems , 1997 .

[10]  D. D. Giusto,et al.  Image data compression by adaptive vector quantization of classified wavelet coefficients , 1997, 1997 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, PACRIM. 10 Years Networking the Pacific Rim, 1987-1997.

[11]  Yongmin Kim,et al.  Using motion-compensated frame-rate conversion for the correction of 3: 2 pulldown artifacts in video sequences , 2000, IEEE Trans. Circuits Syst. Video Technol..

[12]  Peter J. L. van Beek,et al.  Detection of slow-motion replay segments in sports video for highlights generation , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[13]  S. Rachev.  The Monge–Kantorovich Mass Transference Problem and Its Stochastic Applications , 1985 .

[14]  TomasiCarlo,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000 .

[15]  M. Barnsley,et al.  Iterated function systems and the global construction of fractals , 1985, Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences.

[16]  Michele Nappi,et al.  Speed-up in fractal image coding: comparison of methods , 2000, IEEE Trans. Image Process..

[17]  John C. Hart,et al.  Fractal color compression in the L*a*b* uniform color space , 1998, Proceedings DCC '98 Data Compression Conference (Cat. No.98TB100225).

[18]  Kai Uwe Barthel,et al.  Three-dimensional fractal video coding , 1995, Proceedings., International Conference on Image Processing.

[19]  Tao Chen.  Adaptive temporal interpolation using bidirectional motion estimation and compensation , 2002, Proceedings. International Conference on Image Processing.

[20]  Richard Gran,et al.  On the Convergence of Random Search Algorithms In Continuous Time with Applications to Adaptive Control , 1970, IEEE Trans. Syst. Man Cybern..

[21]  Leonidas J. Guibas,et al.  The Earth Mover's Distance under transformation sets , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[22]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[23]  Daniele D. Giusto,et al.  Slow motion replay of video sequences using fractal zooming , 2005, 2005 Digest of Technical Papers. International Conference on Consumer Electronics, 2005. ICCE..

[24]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[25]  O. C. Au,et al.  Comparison between block-based and pixel-based temporal interpolation for video coding , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[26]  Emmanuel Reusens.  Overlapped adaptive partitioning for image coding based on the theory of iterated functions systems , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  Luigi Atzori,et al.  Automatic scene change detection in uncompressed video sequences , 2002 .