Video Compression with 3-D Pose Tracking, PDE-Based Image Coding, and Electrostatic Halftoning

Recent video compression algorithms such as the members of the MPEG or H.26x family use image transformations to store individual frames, and motion compensation between these frames. In contrast, the video codec presented here is a model-based approach that encodes fore- and background independently. It is well-suited for applications with static backgrounds, i.e. for applications such as traffic or security surveillance, or video conferencing. Our video compression algorithm tracks moving foreground objects and stores the obtained poses. Furthermore, a compressed version of the background image and some other information such as 3-D object models are encoded. In a second step, recent halftoning and PDE-based image compression algorithms are employed to compress the encoding error. Experiments show that the stored videos can have a significantly better quality than state-of-the-art algorithms such as MPEG-4.

[1]  Peter Eisert,et al.  Model-based Coding of Facial Image Sequences at Varying Illumination Conditions , 1998 .

[2]  Zhengrong Yao,et al.  Model Based Coding : Initialization, Parameter Extraction and Evaluation , 2005 .

[3]  A MODEL-BASED ENHANCED APPROACH TO DISTRIBUTED VIDEO CODING , 2005 .

[4]  Søren Forchhammer,et al.  Lossy/lossless coding of bi-level images , 1997, Proceedings DCC '97. Data Compression Conference.

[5]  Algirdas Pakstas,et al.  MPEG-4 Facial Animation: The Standard,Implementation and Applications , 2002 .

[6]  Othman Omran Khalifa,et al.  Video Compression Techniques: An Overview , 2010 .

[7]  Allen R. Hanson,et al.  Computer Vision Systems , 1978 .

[8]  Radim Jav,et al.  Model based facial video sequences coding , 2003 .

[9]  B. Girod,et al.  Facial Expression Analysis for Model-Based Coding of Video Sequences , 1997 .

[10]  Sebastian Toelg,et al.  Towards an Example-Based Image Compression Architecture for Video-Conferencing , 1994 .

[11]  Joachim Weickert,et al.  Theoretical Foundations of Anisotropic Diffusion in Image Processing , 1994, Theoretical Foundations of Computer Vision.

[12]  Bodo Rosenhahn,et al.  Localised Mixture Models in Region-Based Tracking , 2009, DAGM-Symposium.

[13]  Joachim Weickert,et al.  Multi‐Class Anisotropic Electrostatic Halftoning , 2012, Comput. Graph. Forum.

[14]  Joachim Weickert,et al.  Beating the Quality of JPEG 2000 with Anisotropic Diffusion , 2009, DAGM-Symposium.

[15]  Joachim Weickert,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Electrostatic Halftoning Electrostatic Halftoning , 2022 .

[16]  Joachim Weickert,et al.  How to Choose Interpolation Data in Images , 2009, SIAM J. Appl. Math..

[17]  James L. Crowley,et al.  Face-Tracking and Coding for Video Compression , 1999, ICVS.

[18]  D. E. Pearson,et al.  Developments in model-based video coding , 1995, Proc. IEEE.

[19]  M. Hamouz,et al.  Model-Based Coding of 3D Head Sequences , 2007, 2007 3DTV Conference.

[20]  Michael J. Black,et al.  HumanEva: Synchronized Video and Motion Capture Dataset and Baseline Algorithm for Evaluation of Articulated Human Motion , 2010, International Journal of Computer Vision.

[21]  Montse Pardàs,et al.  Facial animation parameters extraction and expression recognition using Hidden Markov Models , 2002, Signal Process. Image Commun..

[22]  Gary J. Sullivan,et al.  Video Compression - From Concepts to the H.264/AVC Standard , 2005, Proceedings of the IEEE.