A low-power memory architecture with application-aware power management for motion & disparity estimation in Multiview Video Coding

A low-power architecture for an on-chip multi-banked video memory for motion and disparity estimation in Multiview Video Coding is proposed. The memory organization (size, banks, sectors, etc.) is driven by an extensive analysis of memory-usage behavior for various 3D-video sequences. Considering a multiple-sleep state model, an application-aware power management scheme is employed to reduce the leakage energy of the on-chip memory. The knowledge of motion and disparity estimation algorithm in conjunction with video properties are considered to predict the memory requirements of each Macroblock. A cost function is evaluated to determine an appropriate sleep mode for the idle memory sectors, while considering the wakeup overhead (latency and energy). The complete motion and disparity estimation architecture is implemented in a 65nm low power IBM technology. The experiments (for various test video sequences) demonstrate that our architecture provides up to 80% leakage energy reduction compared to state-of-the-art. Our scheme processes motion and disparity estimation of four HD1080p views encoding at 30fps with a power consumption of 57mW.

[1]  Shengqi Yang,et al.  Power and performance analysis of motion estimation based on hardware and software realizations , 2005, IEEE Transactions on Computers.

[2]  Jiun-In Guo,et al.  A Dynamic Quality-Adjustable H.264 Video Encoder for Power-Aware Video Applications , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Sergio Bampi,et al.  Multi-level pipelined parallel hardware architecture for high throughput motion and disparity estimation in Multiview Video Coding , 2011, 2011 Design, Automation & Test in Europe.

[4]  Liang-Gee Chen,et al.  Fast Algorithm and Architecture Design of Low-Power Integer Motion Estimation for H.264/AVC , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Muhammad Shafique,et al.  An HVS-based Adaptive Computational Complexity Reduction Scheme for H.264/AVC video encoder using Prognostic Early Mode Exclusion , 2010, 2010 Design, Automation & Test in Europe Conference & Exhibition (DATE 2010).

[6]  Chong-Min Kyung,et al.  Selective Search Area Reuse Algorithm for Low External Memory Access Motion Estimation , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Steven Trimberger,et al.  A 90-nm Low-Power FPGA for Battery-Powered Applications , 2006, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[8]  Tihao Chiang,et al.  A Low-Power and Bandwidth-Efficient Motion Estimation IP Core Design Using Binary Search , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Kevin J. Nowka,et al.  Enhanced Leakage Reduction Techniques Using Intermediate Strength Power Gating , 2007, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[10]  Karthick Rajamani,et al.  Application-Aware Power Management , 2006, 2006 IEEE International Symposium on Workload Characterization.

[11]  Yun He,et al.  Fast disparity motion estimation in MVC based on range prediction , 2008, 2008 15th IEEE International Conference on Image Processing.

[12]  Muhammad Shafique,et al.  Low-power adaptive pipelined MPSoCs for multimedia: An H.264 video encoder case study , 2011, 2011 48th ACM/EDAC/IEEE Design Automation Conference (DAC).

[13]  Muhammad Shafique,et al.  enBudget: A Run-Time Adaptive Predictive Energy-Budgeting scheme for energy-aware Motion Estimation in H.264/MPEG-4 AVC video encoder , 2010, 2010 Design, Automation & Test in Europe Conference & Exhibition (DATE 2010).

[14]  Srinivas Katkoori,et al.  State-Retentive Power Gating of Register Files in Multicore Processors Featuring Multithreaded In-Order Cores , 2011, IEEE Transactions on Computers.

[15]  Aljoscha Smolic,et al.  Efficient Prediction Structures for Multiview Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Chengke Wu,et al.  Multiview video coding based on rectified epipolar lines , 2009, 2009 7th International Conference on Information, Communications and Signal Processing (ICICS).

[17]  Luca Fanucci,et al.  Data-adaptive motion estimation algorithm and VLSI architecture design for low-power video systems , 2004 .

[18]  Liang-Gee Chen,et al.  A 212 MPixels/s 4096 $\times$ 2160p Multiview Video Encoder Chip for 3D/Quad Full HDTV Applications , 2010, IEEE Journal of Solid-State Circuits.

[19]  Liang-Gee Chen,et al.  Cache-based integer motion/disparity estimation for quad-HD H.264/AVC and HD multiview video coding , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[20]  Sergio Bampi,et al.  Run-time adaptive energy-aware Motion and Disparity Estimation in Multiview Video Coding , 2011, 2011 48th ACM/EDAC/IEEE Design Automation Conference (DAC).

[21]  Liang-Gee Chen,et al.  Low Power Cache Algorithm and Architecture Design for Fast Motion Estimation in H.264/AVC Encoder System , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[22]  Liang-Gee Chen,et al.  Level C+ data reuse scheme for motion estimation with corresponding coding orders , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Tao Yan,et al.  View-Adaptive Motion Estimation and Disparity Estimation for Low Complexity Multiview Video Coding , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Seda Ogrenci Memik,et al.  Fine-grain leakage optimization in SRAM based FPGAs , 2005, ACM Great Lakes Symposium on VLSI.

[25]  Prashant J. Shenoy,et al.  Chameleon: Application-Level Power Management , 2008, IEEE Transactions on Mobile Computing.

[26]  Kevin J. Nowka,et al.  Power gating with multiple sleep modes , 2006, 7th International Symposium on Quality Electronic Design (ISQED'06).