Lagrange-based Video Encoder Optimisation to Enhance Motion Representation in the Compressed-Domain

Compressed-domain content analysis enables fast content-based video applications. However, conventional encoder implementation, limited to optimising data compression, does not necessarily result in content representative compressed features. In this paper, we present a novel method for video encoder optimisation that enhances reliability of content representation in the compressed video. We propose a configurable encoder model to jointly optimise bit-rate, distortion and content representation of the encoded video. In encoder optimisation for motion estimation, we analyse the behaviour of motion representation and compression efficiency over a range of content complexities. A mathematical model to control the extent of noise in selected motion vectors is presented. We demonstrate that the compressed domain motion information can be enhanced without incurring a rate-distortion overhead. The computational overheads are marginal and can be eliminated by exploiting the inherently parallel nature of the proposed optimisation model.

[1]  Athanassios N. Skodras,et al.  A new data hiding scheme for scene change detection in H.264 encoded video sequences , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[2]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[3]  Janko Calic,et al.  Application-aware video coding architecture using camera and object motion-models , 2011, 2011 6th International Conference on Industrial and Information Systems.

[4]  Warnakulasuriya Anil Chandana Fernando,et al.  Facilitating motion-based vision applications by combined video analysis and coding , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  M. Davies,et al.  Approximating optical flow within the MPEG-2 compressed domain , 2005 .

[6]  Harvey J. Everett Generalized Lagrange Multiplier Method for Solving Problems of Optimum Allocation of Resources , 1963 .

[7]  Avideh Zakhor,et al.  Applications of Video-Content Analysis and Retrieval , 2002, IEEE Multim..

[8]  D. Marpe,et al.  The H.264/MPEG4 advanced video coding standard and its applications , 2006, IEEE Communications Magazine.

[9]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[10]  Yong Man Ro,et al.  Video Event Filtering in Consumer Domain , 2007, IEEE Transactions on Broadcasting.

[11]  Henri Nicolas,et al.  Joint global motion estimation and coding for scalable H.264/SVC high-definition video streams , 2008, 2008 International Workshop on Content-Based Multimedia Indexing.

[12]  S. Gary,et al.  Joint Model Reference Encoding Methods and Decoding Concealment Methods , 2003 .