Low-complexity video encoding for UAV reconnaissance and surveillance

Most video compression schemes like H.264/AVC have a high-complexity encoder with a block motion estimation (ME) engine and a low-complexity decoder. However, applications such as unmanned aerial vehicle (UAV) reconnaissance and surveillance require low-complexity video encoders. Furthermore, in such applications, the majority of the motion in the video sequences is due to the movement of the UAV and the camera mounts which is known. Motivated by this, we propose and investigate a low-complexity encoder with global motion compensation and spectral entropy based bit allocation, but without block ME. The spectral entropy based bit allocation exploits latency to look ahead at data before choosing and coding the coefficients most important for retaining signal fidelity. We show that the proposed encoder achieves better quality at lower bit rates with lower quality variation than that of the H.264 encoder with ME block size restricted to 8×8 for videos typical of UAV flyovers. Compared to the H.264 encoder with 8×8 ME blocks, the proposed encoder requires fewer computations and memory accesses.

[1]  K. Raahemifar,et al.  Encoder rate control for transform domain Wyner-Ziv Video Coding , 2013, 2013 International Conference on Electronics, Computer and Computation (ICECCO).

[2]  Chein-Wei Jen,et al.  On the data reuse and memory bandwidth analysis for full-search block-matching VLSI architecture , 2002, IEEE Trans. Circuits Syst. Video Technol..

[3]  Jerry D. Gibson,et al.  Spectral entropy-based bit allocation , 2010, 2010 International Symposium On Information Theory & Its Applications.

[4]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[5]  Jo Yew Tham,et al.  Complexity-Rate-Distortion Optimization for Real-Time H.264/AVC Encoding , 2009, 2009 Proceedings of 18th International Conference on Computer Communications and Networks.

[6]  Catarina Brites,et al.  Feedback channel in pixel domain Wyner-Ziv video coding: Myths and realities , 2006, 2006 14th European Signal Processing Conference.

[7]  Antti Hallapuro,et al.  High Performance, Low Complexity Video Coding and the Emerging HEVC Standard , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Marco Dalai,et al.  The DISCOVER codec: Architecture, Techniques and Evaluation , 2007, PCS 2007.

[9]  Jinwen Tian,et al.  An Image-Sequence Compressing Algorithm Based on Homography Transformation for Unmanned Aerial Vehicle , 2010, 2010 International Symposium on Intelligence Information Processing and Trusted Computing.

[10]  Vivek K. Goyal,et al.  Theoretical foundations of transform coding , 2001, IEEE Signal Process. Mag..

[11]  Faouzi Kossentini,et al.  H.264/AVC baseline profile decoder complexity analysis , 2003, IEEE Trans. Circuits Syst. Video Technol..

[12]  Alexis M. Tourapis,et al.  Enhanced predictive zonal search for single and multiple frame motion estimation , 2002, IS&T/SPIE Electronic Imaging.

[13]  Ajay Luthra,et al.  The H.264/AVC Advanced Video Coding standard: overview and introduction to the fidelity range extensions , 2004, SPIE Optics + Photonics.

[14]  Wen Gao,et al.  Real-time video coding under power constraint based on H.264 codec , 2007, Electronic Imaging.

[15]  Joumana Farah,et al.  Feedback Channel Suppression in Distributed Video Coding with Adaptive Rate Allocation and Quantization for Multiuser Applications , 2008, EURASIP J. Wirel. Commun. Netw..

[16]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[17]  Rui Zhang,et al.  Wyner-Ziv coding of motion video , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[18]  Jerry D. Gibson,et al.  Coefficient rate and lossy source coding , 2005, IEEE Transactions on Information Theory.

[19]  Martin Fürer Faster integer multiplication , 2007, STOC '07.

[20]  Henrique S. Malvar,et al.  Low-complexity transform and quantization in H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[21]  Chong-Min Kyung,et al.  Selective Search Area Reuse Algorithm for Low External Memory Access Motion Estimation , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Justin Fortna Murtha,et al.  An Evidence Theoretic Approach to Design of Reliable Low-Cost UAVs , 2009 .

[23]  Clark N. Taylor,et al.  Using Telemetry Data For Video Compression On Unmanned Air Vehicles , 2006 .