Design optimization of a global/local tone mapping processor on arm SOC platform for real-time high dynamic range video

As the advance of high quality displays such as organic light- emitting diode (OLED) or laser TV, the importance of a real-time high dynamic range (HDR) data processing for display devices increases significantly. Many tone mapping algorithms are proposed for rendering HDR images or videos on display screens. The choice of tone mapping algorithm depends on characteristics of displays such as luminance range, contrast ratio and gamma correction. An ideal HDR tone mapping processor should include several tone mapping algorithms and be able to select an appropriate one for different kind of devices and applications. Such a HDR tone mapping processor has characteristics of robust core functionality, high flexibility, and low area consumption. An ARM core based system on chip (SOC) platform with HDR tone mapping ASIC is suitable for such applications. In this paper, we present a systematic methodology to develop an optimized architecture for tone mapping processor in the ARM SOC platform. We illustrate the approach by a HDR tone mapping processor that can handle both photographic and gradient compression. The optimization is achieved through four major steps: common module extraction, computation power enhancement, hardware/software partition and cost function analysis. Based on the proposed scheme, we develop an integrated photographic and gradient compression HDR tone mapping processor that can process 1024times768 images at 60 fps. This design runs at 100 MHz clock and consumes area of 13.8 mm2 under TSMC 0.13 mum technology with 50% improvement in speed and area compared with previous results.

[1]  Kenneth Chiu,et al.  Spatially Nonuniform Scaling Functions for High Contrast Images , 1993 .

[2]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting (The Morgan Kaufmann Series in Computer Graphics) , 2005 .

[3]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[4]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[5]  Donald P. Greenberg,et al.  A multiscale model of adaptation and spatial vision for realistic image display , 1998, SIGGRAPH.

[6]  Rui Wang,et al.  Interactive time-dependent tone mapping using programmable graphics hardware , 2003, Rendering Techniques.

[7]  Ching-Te Chiu,et al.  Design and Implementation of a Real-Time Global Tone Mapping Processor for High Dynamic Range Video , 2007, 2007 IEEE International Conference on Image Processing.

[8]  Firas Hassan,et al.  A real-time FPGA-based architecture for a Reinhard-like tone mapping operator , 2007, GH '07.

[9]  Hans-Peter Seidel,et al.  Perception-motivated high dynamic range video encoding , 2004, SIGGRAPH 2004.

[10]  Holly E. Rushmeier,et al.  Tone reproduction for realistic images , 1993, IEEE Computer Graphics and Applications.

[11]  Greg Ward,et al.  High dynamic range imaging , 2001, SIGGRAPH '04.

[12]  Ching-Te Chiu,et al.  Block-Based Gradient Domain High Dynamic Range Compression Design for Real-Time Applications , 2007, 2007 IEEE International Conference on Image Processing.