Low Complexity Video Encoding and High Complexity Decoding for UAV Reconnaissance and Surveillance

Conventional video compression schemes such as H.264/AVC use a high complexity encoder with block motion estimation (ME) and a low complexity, low latency decoder. However, unmanned aerial vehicle (UAV) reconnaissance and surveillance applications require low complexity encoders but can accommodate high complexity decoders. Moreover, the video sequences in these applications often primarily have global motion due to the known movement of the UAV and camera mounts. Motivated by this scenario, we propose and investigate a low complexity encoder with global motion based frame prediction and no block ME. For fly-over videos, our encoder achieves more than a 40% bit rate savings over a H.264 encoder with ME block size restricted to 8 × 8 and at lower complexity. We also develop a high complexity decoder based on Kalman filtering along motion trajectories and show average PSNR improvements of up to 0.5 dB with respect to a classic low complexity decoder.

[1]  Thomas Wiegand,et al.  Using multiple global motion models for improved block-based video coding , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[2]  Jo Yew Tham,et al.  Complexity-Rate-Distortion Optimization for Real-Time H.264/AVC Encoding , 2009, 2009 Proceedings of 18th International Conference on Computer Communications and Networks.

[3]  Jerry D. Gibson,et al.  Global motion compensation and spectral entropy bit allocation for low complexity video coding , 2012, 2012 IEEE International Conference on Communications (ICC).

[4]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[5]  Aggelos K. Katsaggelos,et al.  Multiple global affine motion model for H.264 video coding with low bit rate , 2005, IS&T/SPIE Electronic Imaging.

[6]  Thomas Sikora,et al.  Adaptive global motion temporal prediction for video coding , 2010, 28th Picture Coding Symposium.

[7]  Clark N. Taylor,et al.  Using Telemetry Data For Video Compression On Unmanned Air Vehicles , 2006 .

[8]  Jerry D. Gibson,et al.  A constrained joint source/channel coder design , 1994, IEEE J. Sel. Areas Commun..

[9]  Chein-Wei Jen,et al.  On the data reuse and memory bandwidth analysis for full-search block-matching VLSI architecture , 2002, IEEE Trans. Circuits Syst. Video Technol..

[10]  Faouzi Kossentini,et al.  H.264/AVC baseline profile decoder complexity analysis , 2003, IEEE Trans. Circuits Syst. Video Technol..

[11]  Henrique S. Malvar,et al.  Low-complexity transform and quantization in H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[12]  Catarina Brites,et al.  Encoder Rate Control for Transform Domain Wyner-Ziv Video Coding , 2007, 2007 IEEE International Conference on Image Processing.

[13]  John W. Woods,et al.  Spatio-temporal adaptive 3-D Kalman filter for video , 1997, IEEE Trans. Image Process..

[14]  Alexis M. Tourapis,et al.  Enhanced predictive zonal search for single and multiple frame motion estimation , 2002, IS&T/SPIE Electronic Imaging.

[15]  Catarina Brites,et al.  Learning based decoding approach for improved Wyner-Ziv video coding , 2012, 2012 Picture Coding Symposium.

[16]  Allen Gersho,et al.  Improved decoder for transform coding with application to the JPEG baseline system , 1992, IEEE Trans. Commun..

[17]  New algorithms for estimation with sequentially correlated measurement noise , 1971 .

[18]  Marco Dalai,et al.  The DISCOVER codec: Architecture, Techniques and Evaluation , 2007, PCS 2007.

[19]  Rama Chellappa,et al.  Video coding using hybrid motion compensation , 1997, Proceedings of International Conference on Image Processing.

[20]  A. Murat Tekalp,et al.  Adaptive motion-compensated filtering of noisy image sequences , 1993, IEEE Trans. Circuits Syst. Video Technol..

[21]  Jerry D. Gibson,et al.  Spectral entropy-based bit allocation , 2010, 2010 International Symposium On Information Theory & Its Applications.

[22]  Kenneth Rose,et al.  Estimation-Theoretic Approach to Delayed Decoding of Predictively Encoded Video Sequences , 2013, IEEE Transactions on Image Processing.

[23]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[24]  Jinwen Tian,et al.  An Image-Sequence Compressing Algorithm Based on Homography Transformation for Unmanned Aerial Vehicle , 2010, 2010 International Symposium on Intelligence Information Processing and Trusted Computing.

[25]  Martin Fürer,et al.  Faster integer multiplication , 2007, STOC '07.

[26]  Jerry D. Gibson,et al.  Low-complexity video encoding for UAV reconnaissance and surveillance , 2011, 2011 - MILCOM 2011 Military Communications Conference.

[27]  Heiko Schwarz,et al.  Improved video coding using long-term global motion compensation , 2004, IS&T/SPIE Electronic Imaging.

[28]  Thomas Sikora,et al.  Adaptive Global Motion Temporal Filtering for High Efficiency Video Coding , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[30]  Eric Dubois,et al.  Noise Reduction in Image Sequences Using Motion-Compensated Temporal Filtering , 1984, IEEE Trans. Commun..

[31]  Wen Gao,et al.  Real-time video coding under power constraint based on H.264 codec , 2007, Electronic Imaging.

[32]  Joumana Farah,et al.  Feedback Channel Suppression in Distributed Video Coding with Adaptive Rate Allocation and Quantization for Multiuser Applications , 2008, EURASIP J. Wirel. Commun. Netw..

[33]  Madhukar Budagavi,et al.  Memory Bandwidth and Power Reduction Using Lossy Reference Frame Compression in Video Encoding , 2011, IEEE Transactions on Circuits and Systems for Video Technology.