MPEG Reconfigurable Video Coding

The currentmonolithic and lengthy scheme behind the standardization and the design of new video coding standards is becoming inappropriate to satisfy the dynamism and changing needs of the video coding community. Such a scheme and specification formalism do not enable designers to exploit the clear commonalities between the different codecs, neither at the level of the specification nor at the level of the implementation. Such a problem is one of the main reasons for the typical long time interval elapsing between the time a new idea is validated until it is implemented in consumer products as part of a worldwide standard. The analysis of this problem originated a new standard initiative within the ISO/IEC MPEG committee, called Reconfigurable Video Coding (RVC). The main idea is to develop a video coding standard that overcomes many shortcomings of the current standardization and specification process by updating and progressively incrementing a modular library of components. As the name implies, flexibility and reconfigurability are new attractive features of the RVC standard. The RVC framework is based on the usage of a new actor/dataflow oriented language called CAL for the specification of the standard library and the instantiation of the RVC decoder model. CAL dataflow models expose the intrinsic concurrency of the algorithms by employing the notions of actor programming and dataflow. This chapter gives an overview of the concepts and technologies building the standard RVC framework and the non standard tools supporting the RVC model from the instantiation and simulation of the CAL model to the software and/or hardware code synthesis.

[1]  Ihab Amer,et al.  Reconfigurable video coding: Objectives and technologies , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[2]  Ghislain Roquier,et al.  Methods to explore design space for MPEG RMC codec specifications , 2013, Signal Process. Image Commun..

[3]  Mickaël Raulet,et al.  Classification and transformation of dynamic dataflow programs , 2010, 2010 Conference on Design and Architectures for Signal and Image Processing (DASIP).

[4]  Mickaël Raulet,et al.  Reconfigurable media coding: An overview , 2013, Signal Process. Image Commun..

[5]  Stephen A. Edwards,et al.  Tutorial: Compiling concurrent languages for sequential processors , 2003, TODE.

[6]  Ghislain Roquier,et al.  Automatic software synthesis of dataflow program: An MPEG-4 simple profile decoder case study , 2008, 2008 IEEE Workshop on Signal Processing Systems.

[7]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Sébastien Lafond,et al.  Quasi-Static Scheduling of CAL Actor Networks for Reconfigurable Video Coding , 2011, J. Signal Process. Syst..

[9]  Ghislain Roquier,et al.  Software Code Generation for the RVC-CAL Language , 2011, J. Signal Process. Syst..

[10]  Gilles Kahn,et al.  Coroutines and Networks of Parallel Processes , 1977, IFIP Congress.

[11]  Mickaël Raulet,et al.  Validation of bitstream syntax and synthesis of parsers in the MPEG Reconfigurable Video Coding framework , 2008, 2008 IEEE Workshop on Signal Processing Systems.

[12]  M. Raulet,et al.  An LLVM-based decoder for MPEG Reconfigurable Video Coding , 2010, 2010 IEEE Workshop On Signal Processing Systems.

[13]  Marius Preda,et al.  3D graphics coding in a reconfigurable environment , 2013, Signal Process. Image Commun..

[14]  Vikram S. Adve,et al.  LLVM: a compilation framework for lifelong program analysis & transformation , 2004, International Symposium on Code Generation and Optimization, 2004. CGO 2004..

[15]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, SPIE Optics + Photonics.

[16]  E.A. Lee,et al.  Synchronous data flow , 1987, Proceedings of the IEEE.

[17]  Ghislain Roquier,et al.  Scheduling of dynamic dataflow programs based on state space analysis , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Ghislain Roquier,et al.  Scheduling of dynamic dataflow programs with model checking , 2011, 2011 IEEE Workshop on Signal Processing Systems (SiPS).

[19]  Shuvra S. Bhattacharyya,et al.  Parameterized dataflow modeling for DSP systems , 2001, IEEE Trans. Signal Process..

[20]  Gilles Kahn,et al.  The Semantics of a Simple Language for Parallel Programming , 1974, IFIP Congress.

[21]  Jörn W. Janneck A machine model for dataflow actors and its applications , 2011, 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[22]  Ghislain Roquier,et al.  Synthesizing Hardware from Dataflow Programs , 2008, 2008 IEEE Workshop on Signal Processing Systems.

[23]  Edward A. Lee The problem with threads , 2006, Computer.

[24]  Mickaël Raulet,et al.  LLVM-based and scalable MPEG-RVC decoder , 2010, Journal of Real-Time Image Processing.

[25]  Johan Eker,et al.  CAL language report: Specification of the CAL actor language , 2003 .

[26]  Peter D. Symes Video Compression , 1998 .

[27]  Mickaël Raulet,et al.  Overview of the MPEG Reconfigurable Video Coding Framework , 2011, J. Signal Process. Syst..

[28]  Johan Eker,et al.  Efficient realization of a cal video decoder on a mobile terminal (position paper) , 2008, 2008 IEEE Workshop on Signal Processing Systems.

[29]  Mickaël Raulet,et al.  Automatic synthesis of TTA processor networks from RVC-CAL dataflow programs , 2011, 2011 IEEE Workshop on Signal Processing Systems (SiPS).

[30]  Mickaël Raulet,et al.  The Reconfigurable Video Coding Standard [Standards in a Nutshell] , 2010, IEEE Signal Processing Magazine.

[31]  Joseph Thomas-Kerr,et al.  Reconfigurable Media Coding: Self-Describing Multimedia Bitstreams , 2007, 2007 IEEE Workshop on Signal Processing Systems.

[32]  Vikas Agarwal,et al.  Clock rate versus IPC: the end of the road for conventional microarchitectures , 2000, Proceedings of 27th International Symposium on Computer Architecture (IEEE Cat. No.RS00201).

[33]  Mickaël Raulet,et al.  OpenDF: a dataflow toolset for reconfigurable hardware and multicore systems , 2008, CARN.

[34]  Jean A. Peperstraete,et al.  Cycle-static dataflow , 1996, IEEE Trans. Signal Process..

[35]  Mickaël Raulet,et al.  Efficient multicore scheduling of dataflow process networks , 2011, 2011 IEEE Workshop on Signal Processing Systems (SiPS).

[36]  Jörn W. Janneck,et al.  Profiling dataflow programs , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[37]  Mickaël Raulet,et al.  Reconfigurable video coding: a stream programming approach to the specification of new video coding standards , 2010, MMSys '10.

[38]  Shuvra S. Bhattacharyya,et al.  Functional DIF for Rapid Prototyping , 2008, 2008 The 19th IEEE/IFIP International Symposium on Rapid System Prototyping.

[39]  Jarmo Takala,et al.  Customized Exposed Datapath Soft-Core Design Flow with Compiler Support , 2010, 2010 International Conference on Field Programmable Logic and Applications.

[40]  Ghislain Roquier,et al.  High-level dataflow design of signal processing systems for reconfigurable and multicore heterogeneous platforms , 2013, Journal of Real-Time Image Processing.

[41]  Lu Yu,et al.  Video decoder reconfigurations and AVS extensions in the new MPEG reconfigurable video coding framework , 2008, 2008 IEEE Workshop on Signal Processing Systems.

[42]  Konstantinos Konstantinides Digital Signal Processing in Home Entertainment , 2013, Handbook of Signal Processing Systems.

[43]  Ghislain Roquier,et al.  Hardware and Software Synthesis of Heterogeneous Systems from Dataflow Programs , 2012, J. Electr. Comput. Eng..

[44]  Mickaël Raulet,et al.  An RVC dataflow description of the AVC Constrained Baseline Profile decoder , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[45]  Rik Van de Walle,et al.  Is That a Fish in Your Ear? A Universal Metalanguage for Multimedia , 2007, IEEE MultiMedia.

[46]  Marco Mattavelli MPEG Reconfigurable Video Representation , 2012 .

[47]  Ghislain Roquier,et al.  Synthesizing hardware from dataflow programs: An MPEG-4 simple profile decoder case study , 2008, SiPS.

[48]  Edward A. Lee,et al.  Dataflow process networks , 1995, Proc. IEEE.

[49]  Mickaël Raulet,et al.  Exploring the Concurrency of an MPEG RVC Decoder Based on Dataflow Program Analysis , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[50]  Christian Haubelt,et al.  Classification of General Data Flow Actors into Known Models of Computation , 2008, 2008 6th ACM/IEEE International Conference on Formal Methods and Models for Co-Design.

[51]  Mickaël Raulet,et al.  A portable Video Tool Library for MPEG Reconfigurable Video Coding using LLVM representation , 2010, 2010 Conference on Design and Architectures for Signal and Image Processing (DASIP).

[52]  Matías Toril,et al.  Design of a Computationally Efficient Dynamic System-Level Simulator for Enterprise LTE Femtocell Scenarios , 2012, J. Electr. Comput. Eng..

[53]  Ab Al-Hadi Ab Rahman,et al.  Pipeline synthesis and optimization of FPGA-based video processing applications with CAL , 2011, EURASIP J. Image Video Process..