Low Complexity HEVC Encoder for Visual Sensor Networks

Visual sensor networks (VSNs) can be widely applied in security surveillance, environmental monitoring, smart rooms, etc. However, with the increased number of camera nodes in VSNs, the volume of the visual information data increases significantly, which becomes a challenge for storage, processing and transmitting the visual data. The state-of-the-art video compression standard, high efficiency video coding (HEVC), can effectively compress the raw visual data, while the higher compression rate comes at the cost of heavy computational complexity. Hence, reducing the encoding complexity becomes vital for the HEVC encoder to be used in VSNs. In this paper, we propose a fast coding unit (CU) depth decision method to reduce the encoding complexity of the HEVC encoder for VSNs. Firstly, the content property of the CU is analyzed. Then, an early CU depth decision method and a low complexity distortion calculation method are proposed for the CUs with homogenous content. Experimental results show that the proposed method achieves 71.91% on average encoding time savings for the HEVC encoder for VSNs.

[1]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[2]  Wendi B. Heinzelman,et al.  A Survey of Visual Sensor Networks , 2009, Adv. Multim..

[3]  Naoki Wakamiya,et al.  Challenging issues in visual sensor networks , 2009, IEEE Wireless Communications.

[4]  Jin Soo Choi,et al.  Early Coding Unit–Splitting Termination Algorithm for High Efficiency Video Coding (HEVC) , 2014 .

[5]  Long Xu,et al.  Predictive and distribution-oriented fast motion estimation for H.264/AVC , 2012, Journal of Real-Time Image Processing.

[6]  Luiz Affonso Guedes,et al.  Availability Issues in Wireless Visual Sensor Networks , 2014, Sensors.

[7]  Guifen Tian,et al.  Content adaptive prediction unit size decision algorithm for HEVC intra coding , 2012, 2012 Picture Coding Symposium.

[8]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Fan Zhang,et al.  Reduced-Reference Image Quality Assessment Using Reorganized DCT-Based Image Representation , 2011, IEEE Transactions on Multimedia.

[10]  Sam Kwong,et al.  Efficient Motion and Disparity Estimation Optimization for Low Complexity Multiview Video Coding , 2015, IEEE Transactions on Broadcasting.

[11]  Yongwha Chung,et al.  Fast Video Encryption Using the H.264 Error Propagation Property for Smart Mobile Devices , 2015, Sensors.

[12]  Munchurl Kim,et al.  A Novel Fast CU Encoding Scheme Based on Spatiotemporal Encoding Parameters for HEVC Inter Coding , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Jianjun Lei,et al.  Early MERGE Mode Decision Based on Motion Estimation and Hierarchical Depth Correlation for HEVC , 2014, IEEE Transactions on Broadcasting.

[14]  Liang Fan,et al.  A fast CU size decision algorithm based on adaptive depth selection for HEVC encoder , 2014, 2014 International Conference on Audio, Language and Image Processing.

[15]  Jianjun Lei,et al.  Fast Coding Tree Unit depth decision for high efficiency video coding , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[16]  Byeungwoo Jeon,et al.  Early Skip Mode Decision for HEVC Encoder With Emphasis on Coding Quality , 2015, IEEE Transactions on Broadcasting.

[17]  Jianfeng Xu,et al.  Fast integer-pel and fractional-pel motion estimation for H.264/AVC , 2006, J. Vis. Commun. Image Represent..

[18]  King Ngi Ngan,et al.  Reduced-reference image quality assessment in reorganized DCT domain , 2013, Signal Process. Image Commun..

[19]  Long Xu,et al.  Machine Learning-Based Coding Unit Depth Decisions for Flexible Complexity Allocation in High Efficiency Video Coding , 2015, IEEE Transactions on Image Processing.

[20]  Shuai Li,et al.  Rate control of hierarchical B prediction structure for multi-view video coding , 2013, Multimedia Tools and Applications.

[21]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[22]  Jianjun Lei,et al.  Fast Transform Unit Depth Decision Based on Quantized Coefficients for HEVC , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[23]  Nam Ling,et al.  Fast skip mode decision with rate-distortion optimization for High Efficiency Video Coding , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[24]  Sam Kwong,et al.  A Direction-Based Unsymmetrical-Cross Multi-Hexagon-Grid Search Algorithm for H.264/AVC Motion Estimation , 2013, Journal of Signal Processing Systems.

[25]  Fan Zhang,et al.  Adaptive Block-size Transform based Just-Noticeable Difference model for images/videos , 2011, Signal Process. Image Commun..

[26]  Luiz Affonso Guedes,et al.  A Survey on Multimedia-Based Cross-Layer Optimization in Visual Sensor Networks , 2011, Sensors.

[27]  Gary J. Sullivan,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Jungyoup Yang,et al.  Early determination of mode decision for HEVC , 2012, 2012 Picture Coding Symposium.

[29]  Yuxiang Wang,et al.  Construction of Tree Network with Limited Delivery Latency in Homogeneous Wireless Sensor Networks , 2014, Wirel. Pers. Commun..