Processing and storage models for mpeg-2 main level and high level video decoding: a block-level pipeline approach

A novel MPEG-2 video processing model, termed Block-Level-Pipeline (BLP) processing scheme, is introduced. Under BLP control, not only does each processing unit process video data on a block-by-block basis in a video decoder, but also accesses external frame memory for motion compensation on a block-by-block basis. Thus, the data bus width requirement and the associated internal buffer sizes can be minimized because the BLP processing model can evenly distribute data bus traffic in time. Besides providing the compact design of data bus and internal buffers, the BLP scheme also can simplify the architecture design of each processing unit because their computation load can be relieved on this block-by-block basis. The description of the BLP design methodology is complete and precise because it takes processing model, resource management, and process management into account. This methodology can provide valuable estimations for system requirements in the early design stages of MPEG-2 products. An efficient interlacing frame memory storage organization and a deterministic fairness-priority bus scheduling scheme are also presented. This simple storing pattern can efficiently lower the probability of occurrence of page-break when accessing the external frame memory. Reducing DRAM access latencies is an important issue in a limited bandwidth system design. Unlike other real-time systems, the bus scheduler can be simplified to a deterministic and fairness-priority approach due to only one block of data being conveyed on the bus at one time. With this short-duration data transfer approach, a complicated bus scheduler to prevent starvation conditions is not needed. Based on these work, two designs of MPEG-2 video decoders for DVD and HDTV applications are demonstrated collectively in this dissertation.

[1]  Bao,et al.  A New Approach For Memory Efficient ATV Decoding , 1997, 1997 International Conference on Consumer Electronics.

[2]  Massimo Maresca,et al.  Image processing on high-performance RISC systems , 1996, Proc. IEEE.

[3]  Yasoo Harada,et al.  Single chip video processor for digital HDTV , 2001, IEEE Trans. Consumer Electron..

[4]  Steven W. White,et al.  How does processor MHZ relate to end-user performance? I. Pipelines and functional units , 1993, IEEE Micro.

[5]  Nikil D. Dutt,et al.  Low-power memory mapping through reducing address bus activity , 1999, IEEE Trans. Very Large Scale Integr. Syst..

[6]  Ralf Steinmetz,et al.  Human Perception of Jitter and Media Synchronization , 1996, IEEE J. Sel. Areas Commun..

[7]  Anantha P. Chandrakasan,et al.  Minimizing power consumption in digital CMOS circuits , 1995, Proc. IEEE.

[8]  Jar-Ferr Yang,et al.  An efficient two-dimensional inverse discrete cosine transform algorithm for HDTV receivers , 1995, IEEE Trans. Circuits Syst. Video Technol..

[9]  Nam Ling,et al.  A real-time HDTV video decoder , 2001, 2001 IEEE Workshop on Signal Processing Systems. SiPS 2001. Design and Implementation (Cat. No.01TH8578).

[10]  Soo-Ik Chae,et al.  New MPEG2 decoder architecture using frequency scaling , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[11]  H. Hanaki,et al.  A 2.2 GOPS video DSP with 2-RISC MIMD, 6-PE SIMD architecture for real-time MPEG2 video coding/decoding , 1997, 1997 IEEE International Solids-State Circuits Conference. Digest of Technical Papers.

[12]  David C. van Voorhis Constructing codes with bounded codeword lengths (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[13]  Nam Ling,et al.  MPEG-2 video decoder for DVD , 1999 .

[14]  Wen-Hsiung Chen,et al.  A Fast Computational Algorithm for the Discrete Cosine Transform , 1977, IEEE Trans. Commun..

[15]  Songyu Yu,et al.  Design and implementation of HDTV source decoder , 1998 .

[16]  Steven W. White,et al.  How does processor MHz relate to end-user performance? II. Memory subsystem and instruction set , 1993, IEEE Micro.

[17]  W. H. Paik,et al.  The Grand Alliance system for US HDTV , 1995 .

[18]  A. Chimienti,et al.  A Novel Adaptive Vector Quantization Method For Memory Reduction In Mpeg-2 Hdtv Decoders , 1998, International 1998 Conference on Consumer Electronics.

[19]  Liang-Gee Chen,et al.  Architecture design of MPEG-2 decoder system , 1995, Proceedings of International Conference on Consumer Electronics.

[20]  Takao Onoye,et al.  HDTV level MPEG2 video decoder VLSI , 1995, 1995 IEEE TENCON. IEEE Region 10 International Conference on Microelectronics and VLSI. 'Asia-Pacific Microelectronics 2000'. Proceedings.

[21]  Barry G. Haskell,et al.  Adaptive frame/field motion compensated video coding , 1993, Signal Process. Image Commun..

[22]  Tanaka,et al.  A Real-time Software MPEG-2 Decoder For Multimedia PCs , 1997, 1997 International Conference on Consumer Electronics.

[23]  Teresa H. Y. Meng,et al.  A parallel decoder of programmable Huffman codes , 1995, IEEE Trans. Circuits Syst. Video Technol..

[24]  Francky Catthoor,et al.  Low-power data transfer and storage exploration for H.263 video decoder system , 1998, IEEE J. Sel. Areas Commun..

[25]  Shih-Fu Chang,et al.  Designing High-Throughput VLC Decoder , 1992 .

[26]  Heonchul Park,et al.  Area efficient fast Huffman decoder for multimedia applications , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[27]  A. Cugnini,et al.  MPEG-2 video decoder for the digital HDTV Grand Alliance system , 1995 .

[28]  G. Barr,et al.  A single chip multimedia video processor , 1994, Proceedings of IEEE Custom Integrated Circuits Conference - CICC '94.

[29]  Takao Onoye,et al.  Single Chip Implementation of MPEG2 Decoder for HDTV Level Pictures (Special Section of Selected Papers from the 8th Karuizawa Workshop on Circuits and Systems) , 1996 .

[30]  Ja-Ling Wu,et al.  Real-time PC-based software implementation of H.261 video codec , 1997 .

[31]  Martin Vetterli,et al.  Fast 2-D discrete cosine transform , 1985, ICASSP '85. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[32]  Susumu Yoshida,et al.  A low-power MPEG-2 codec LSI for consumer cameras , 1999, 1999 Digest of Technical Papers. International Conference on Consumer Electronics (Cat. No.99CH36277).

[33]  J. Knobloch,et al.  A programmable audio/video processor for H.320, H.324, and MPEG , 1996, 1996 IEEE International Solid-State Circuits Conference. Digest of TEchnical Papers, ISSCC.

[34]  Paul C. H. Lee Performance analysis of an MPEG-II audio/video player , 1999, IEEE Trans. Consumer Electron..

[35]  Sakae Okubo,et al.  MPEG-2 requirements, profiles and performance verification - Framework for developing a generic video coding standard , 1995, Signal Process. Image Commun..

[36]  Cheng-Teh Hsieh Cheng-Teh Hsieh,et al.  A concurrent memory-efficient VLC decoder for MPEG applications , 1996 .

[37]  Kai Hwang,et al.  Advanced computer architecture - parallelism, scalability, programmability , 1992 .

[38]  Peter Pirsch,et al.  VLSI architectures for video compression-a survey , 1995, Proc. IEEE.

[39]  Mircea R. Stan,et al.  Bus-invert coding for low-power I/O , 1995, IEEE Trans. Very Large Scale Integr. Syst..

[40]  Jay K. Strosnider,et al.  Scheduling analysis of the Micro Channel Architecture for multimedia applications , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[41]  Ragunathan Rajkumar Task synchronization in real-time systems , 1989 .

[42]  Anantha Chandrakasan,et al.  A low power variable length decoder for MPEG-2 based on nonuniform fine-grain table partitioning , 1999, IEEE Trans. Very Large Scale Integr. Syst..

[43]  Nam Ling,et al.  A Real-Time Video Decoder for Digital HDTV , 2003, J. VLSI Signal Process..

[44]  Kyu-Seok Kim,et al.  Symbol-parallel Vlc Decoding Architecture For Hdtv Application , 1998, International 1998 Conference on Consumer Electronics.

[45]  Shawmin Lei,et al.  An entropy coding system for digital HDTV applications , 1991, IEEE Trans. Circuits Syst. Video Technol..

[46]  Farhad Kamangar,et al.  Fast Algorithms for the 2-D Discrete Cosine Transform , 1982, IEEE Transactions on Computers.

[47]  Nam Ling,et al.  A bus-monitoring model for MPEG video decoder design , 1997 .

[48]  Nam Ling,et al.  Memory reduction by Haar wavelet transform for MPEG decoder , 1999, 1999 Digest of Technical Papers. International Conference on Consumer Electronics (Cat. No.99CH36277).

[49]  Teresa H. Y. Meng,et al.  A comparison of fast inverse discrete cosine transform algorithms , 1994, Multimedia Systems.

[50]  Nam Ling,et al.  Architecture for Real-time HDTV Video Decoding , 1999 .

[51]  Y. Nakagome,et al.  Trends in low-power RAM circuit technologies , 1994, Proceedings of 1994 IEEE Symposium on Low Power Electronics.

[52]  Kenji Maeguchi,et al.  A single-chip MPEG2 video decoder LSI , 1994, Proceedings of IEEE International Solid-State Circuits Conference - ISSCC '94.

[53]  Tetsuro Takizawa,et al.  An efficient memory arbitration algorithm for a single chip MPEG2 AV decoder , 2001, IEEE Trans. Consumer Electron..

[54]  Hui Wang,et al.  A novel HDTV video decoder and decentralized control scheme , 2001, IEEE Trans. Consumer Electron..

[55]  Alan Jay Smith,et al.  Measuring Cache and TLB Performance and Their Effect on Benchmark Runtimes , 1995, IEEE Trans. Computers.

[56]  Chung Laung Liu,et al.  Scheduling Algorithms for Multiprogramming in a Hard-Real-Time Environment , 1989, JACM.

[57]  David G. Messerschmitt,et al.  Designing a high-throughput VLC decoder. I. Parallel decoding methods , 1992, IEEE Trans. Circuits Syst. Video Technol..

[58]  M. Tremblay,et al.  Partners in platform design , 1995 .

[59]  R. Hopkins Digital terrestrial HDTV for North America: the Grand Alliance HDTV system , 1994 .

[60]  John P. Lehoczky,et al.  The rate monotonic scheduling algorithm: exact characterization and average case behavior , 1989, [1989] Proceedings. Real-Time Systems Symposium.

[61]  Wu,et al.  An HDTV Video Decoder IC For ATV Receivers , 1997, 1997 International Conference on Consumer Electronics.

[62]  Toshiro Ishikawa,et al.  A 600 mW Single Chip MPEG2 Video Decoder , 1995 .

[63]  Leonardo Chiariglione MPEG and multimedia communications , 1997, IEEE Trans. Circuits Syst. Video Technol..

[64]  Takashi Urano,et al.  A low-power single-chip MPEG2 (half-D1) video codec LSI for portable consumer-products applications , 1999, 1999 Digest of Technical Papers. International Conference on Consumer Electronics (Cat. No.99CH36277).

[65]  Mostafa A. Bassiouni,et al.  Efficient VLSI designs for data transformation of tree-based codes , 1991 .

[66]  Sharon S. Peng,et al.  Low-cost HD to SD video decoding , 1999, 1999 Digest of Technical Papers. International Conference on Consumer Electronics (Cat. No.99CH36277).

[67]  N. Ahmed,et al.  Discrete Cosine Transform , 1996 .

[68]  Y. Ooi,et al.  A 162 Mbit/s variable length decoding circuit using an adaptive tree search technique , 1994, Proceedings of IEEE Custom Integrated Circuits Conference - CICC '94.

[69]  Akiyama,et al.  Video Decoder And AC-3 Audio Decoder LSIs For DVD Player , 1997, 1997 International Conference on Consumer Electronics.

[70]  Takao Onoye,et al.  VLSI implementation of inverse discrete cosine transformer and motion compensator for MPEG2 HDTV video decoding , 1995, IEEE Trans. Circuits Syst. Video Technol..

[71]  Ralf Steinmetz Analyzing The Multimedia Operating System , 1995, IEEE Multim..

[72]  Chris Toumazou,et al.  VLSI Implementation of MPEG Decoders , 1996 .

[73]  J. Wiseman,et al.  An Introduction to MPEG Video Compression , 1999 .

[74]  Woojin Kim,et al.  A single-chip HDTV A/V decoder for low-cost DTV receiver , 1999, 1999 Digest of Technical Papers. International Conference on Consumer Electronics (Cat. No.99CH36277).

[75]  Seehyun Kim,et al.  Fixed-point error analysis and word length optimization of 8×8 IDCT architectures , 1998, IEEE Trans. Circuits Syst. Video Technol..

[76]  Teresa H. Meng,et al.  Portable video-on-demand in wireless communication , 1995, Proc. IEEE.

[77]  M. S. Deiss Mp@hl Mpeg2 Video Decoder Ic For Consumer Atsc Receivers , 1998, International 1998 Conference on Consumer Electronics.

[78]  Jun Rim Choi,et al.  A 400 MPixel/s IDCT for HDTV by multibit coding and group symmetry , 1997, 1997 IEEE International Solids-State Circuits Conference. Digest of Technical Papers.

[79]  Mark Horowitz,et al.  Energy dissipation in general purpose microprocessors , 1996, IEEE J. Solid State Circuits.

[80]  R. Sita,et al.  A Single-chip Hdtv Video Decoder Design , 1998, International 1998 Conference on Consumer Electronics.

[81]  Masahiko Yoshimoto,et al.  An MPEG2 Video Decoder LSI with Hierarchical Control Mechanism , 1995 .

[82]  Nam Ling,et al.  Architecture and bus-arbitration schemes for MPEG-2 video decoder , 1999, IEEE Trans. Circuits Syst. Video Technol..

[83]  Michael J. Flynn,et al.  Very high-speed computing systems , 1966 .

[84]  Ruby B. Lee,et al.  Algorithmic and architectural enhancements for real-time MPEG-1 decoding on a general purpose RISC workstation , 1995, IEEE Trans. Circuits Syst. Video Technol..

[85]  M. Liou,et al.  A concurrent architecture for VLSI implementation of discrete cosine transform , 1987, IEEE Transactions on Circuits and Systems.

[86]  H. Takeno,et al.  A video DSP with a macroblock-level-pipeline and a SIMD type vector-pipeline architecture for MPEG2 codec , 1994, Proceedings of IEEE International Solid-State Circuits Conference - ISSCC '94.

[87]  Tae Geun Kim,et al.  VLSI Implementation of MPEG-2 Decoder , 1995 .

[88]  Peter Pirsch,et al.  Architecture and memory requirements for stand-alone and hierarchical MPEG2 HDTV-decoders with synchronous DRAMs , 1995, Proceedings of ISCAS'95 - International Symposium on Circuits and Systems.

[89]  Nam Ling,et al.  An efficient controller scheme for MPEG-2 video decoder , 1998 .

[90]  Nam Ling,et al.  Real-time video decoding scheme for HDTV set-top boxes , 2002, IEEE Trans. Broadcast..

[91]  C.L. Lee,et al.  IMPLEMENTATION OF DIGITAL HDTV VIDEO DECODER BY MULTIPLE MULTIMEDIA VIDEO PROCESSORS , 1996, 1996. Digest of Technical Papers., International Conference on Consumer Electronics.

[92]  O. Popp,et al.  A 1.5 GIPS video signal processor (VSP) , 1994, Proceedings of IEEE Custom Integrated Circuits Conference - CICC '94.

[93]  David A. Huffman,et al.  A method for the construction of minimum-redundancy codes , 1952, Proceedings of the IRE.

[94]  Jay K. Strosnider,et al.  Engineering and Analysis of Fixed Priority Schedulers , 1993, IEEE Trans. Software Eng..

[95]  Lee-Sup Kim,et al.  200 MHz video compression macrocells using low-swing differential logic , 1994, Proceedings of IEEE International Solid-State Circuits Conference - ISSCC '94.

[96]  Betty Prince High Performance Memories: New Architecture DRAMs and SRAMs — Evolution and Function , 1996 .

[97]  Arun N. Netravali,et al.  Digital Video: An introduction to MPEG-2 , 1996 .

[98]  V. K. Prasanna,et al.  Area efficient VLSI architectures for Huffman coding , 1993 .

[99]  G.S. Moschytz,et al.  Practical fast 1-D DCT algorithms with 11 multiplications , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[100]  Obed Duardo,et al.  A cost effective HDTV decoder IC with integrated system controller, down converter, graphics engine and display processor , 1999, IEEE Trans. Consumer Electron..

[101]  Reza Hashemian Design and hardware implementation of a memory efficient Huffman decoding , 1994 .

[102]  Soo-Ik Chae,et al.  A cost-effective architecture for HDTV video decoder in ATSC receivers , 1998 .

[103]  Bing Sheu Microsystems Technology for Multimedia Applications: An Introduction , 1995 .

[104]  N. Cho,et al.  Fast algorithm and implementation of 2-D discrete cosine transform , 1991 .

[105]  Nam Ling,et al.  An efficient video decoder design for MPEG-2 MP@ML , 1997, Proceedings IEEE International Conference on Application-Specific Systems, Architectures and Processors.

[106]  Konstantinos Konstantinides,et al.  Image and video compression standards , 1995 .

[107]  Fabrizio Frescura,et al.  DSP based OFDM demodulator and equalizer for professional DVB-T receivers , 1999 .

[108]  Pierre Duhamel,et al.  Polynomial transform computation of the 2-D DCT , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[109]  Juan M. Meneses,et al.  A High-Performance Architecture with a Macroblock-Level-Pipeline for MPEG-2 Coding , 1996, Real Time Imaging.

[110]  M. N. Liu MPEG decoder architecture for embedded applications , 1996 .

[111]  Nam Ling,et al.  A novel dual-path architecture for HDTV video decoding , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[112]  Seong-Mo Park,et al.  High Speed Search and an Area Efficient Huffman Decoder (Special Section of Papers Selected from ITC-CSCC '98) , 1999 .

[113]  B. Lee A new algorithm to compute the discrete cosine Transform , 1984 .

[114]  Masahiko Yoshimoto,et al.  A 100-MHz 2-D discrete cosine transform core processor , 1992 .

[115]  Geib,et al.  Reducing Memory In MPEG2-video-decoder-architecture , 1997, 1997 International Conference on Consumer Electronics.

[116]  Ephraim Feig,et al.  Fast algorithms for the discrete cosine transform , 1992, IEEE Trans. Signal Process..

[117]  B. Ackland,et al.  The role of VLSI in multimedia , 1993, Symposium 1993 on VLSI Circuits.