MapReduce-Based Distributed Video Encoding Using Content-Aware Video Segmentation and Scheduling

The objective of this paper is to improve the overall performance of distributed encoding, with a particular focus on encoding speed. The proposed scheme consists of content-aware video segmentation and scheduling that consists of two major parts. In the first part, segmentation is carried out with greater efficiency by considering changes in the video content, and in the second part, the segment assignment process is carried out using an efficient scheduling scheme that changes the encoding order of the segments. We measured the content similarity by using the sum of absolute difference algorithm and then applied a threshold to define the degree of change in similarity. The video was segmented based on the extent to which the similarity had changed, and the encoding order of the segments was rearranged to perform distributed encoding. Finally, this paper introduces the MapReduce-based distributed video encoding, using the content-aware video segmentation and scheduling described above, and presents the results of the performance using this scheme, which indicate that the proposed scheme increases the bitrate by a maximum of 2.9% over existing segmentation schemes, and also increases the speed by a maximum of 15.3%.

[1]  D. Kesavaraja,et al.  Hadoop scalable Video Transcoding technique in cloud environment , 2015, 2015 IEEE 9th International Conference on Intelligent Systems and Control (ISCO).

[2]  Byoung-Dai Lee,et al.  Toward Content-Aware Video Partitioning Methods for Distributed HEVC Video Encoding , 2015 .

[3]  Xinggong Zhang,et al.  Parallelizing video transcoding using Map-Reduce-based cloud computing , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[4]  Bernd Girod,et al.  Transform-domain Wyner-Ziv codec for video , 2004, IS&T/SPIE Electronic Imaging.

[5]  Gerassimos D. Barlas Cluster-based optimized parallel video transcoding , 2012, Parallel Comput..

[6]  Jiangtao Wen,et al.  Efficient Software H.264/AVC to HEVC Transcoding on Distributed Multicore Processors , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[8]  Zhou Lei,et al.  Distributed video transcoding based on MapReduce , 2014, 2014 IEEE/ACIS 13th International Conference on Computer and Information Science (ICIS).

[9]  Jongho Nang,et al.  An effective parallelizing scheme of MPEG-1 video encoding on Ethernet-connected workstations , 1997, Proceedings. Advances in Parallel and Distributed Computing.

[10]  Denilson Barbosa,et al.  Parallelizing MPEG video encoding using multiprocessors , 1999, XII Brazilian Symposium on Computer Graphics and Image Processing (Cat. No.PR00481).

[11]  Mea Wang,et al.  Does chunk size matter in distributed video transcoding? , 2015, 2015 IEEE 23rd International Symposium on Quality of Service (IWQoS).

[12]  Timo Hämäläinen,et al.  A High-Performance Sum of Absolute Difference Implementation for Motion Estimation , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Yongdong Zhang,et al.  Efficient Parallel Framework for HEVC Motion Estimation on Many-Core Processors , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Naoki Wakamiya,et al.  High-Speed Distributed Video Transcoding for Multiple Rates and Formats , 2005, IEICE Trans. Inf. Syst..

[15]  Nanning Zheng,et al.  High performance cluster-based transcoder , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[16]  Jun Sun,et al.  A Novel Wavefront-Based High Parallel Solution for HEVC Encoding , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[18]  Karin K. Breitman,et al.  An Architecture for Distributed High Performance Video Processing in the Cloud , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[19]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[20]  Jie Jiang,et al.  Block-Based Parallel Intra Prediction Scheme for HEVC , 2012, J. Multim..

[21]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Rui Zhang,et al.  Wyner-Ziv coding of motion video , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[24]  Haoyu Xu,et al.  Design and Experiment Analysis of a Hadoop-Based Video Transcoding System for Next-Generation Wireless Sensor Networks , 2014, Int. J. Distributed Sens. Networks.