A real-time implementation of gradient domain high dynamic range compression using a local Poisson solver

This paper presents a real-time hardware implementation of a gradient domain dynamic range compression algorithm for high dynamic range (HDR) images. This technique works by calculating the gradients of the HDR image, manipulating those gradients, and reconstructing an output low dynamic range image that corresponds to the manipulated gradients. Reconstruction involves solving the Poisson equation. We propose a Poisson solver that utilizes only local information around each pixel along with special boundary conditions, and requires a small and fixed amount of hardware for any image size, with no need to buffer the entire image. The hardware implementation is described in VHDL and synthesized for a field programmable gate array (FPGA) device. The maximum operating frequency achieved is fast enough to process high dynamic range videos with one megapixel per frame at a rate of about 100 frames per second. The hardware is tested on standard HDR images from the Debevec library. The output images produced have good visual quality.

[1]  Michael M. Kazhdan,et al.  Streaming multigrid for gradient-domain operations on large images , 2008, ACM Trans. Graph..

[2]  Greg Ward,et al.  High dynamic range imaging , 2001, SIGGRAPH '04.

[3]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[4]  Donald P. Greenberg,et al.  A multiscale model of adaptation and spatial vision for realistic image display , 1998, SIGGRAPH.

[5]  Alan Chalmers,et al.  Evaluation of tone mapping operators using a High Dynamic Range display , 2005, SIGGRAPH 2005.

[6]  Xian-He Sun,et al.  A high-order fast direct solver for singular Poisson equation , 2001 .

[7]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[8]  Greg Turk,et al.  LCIS: a boundary hierarchy for detail-preserving contrast reduction , 1999, SIGGRAPH.

[9]  Ching-Te Chiu,et al.  Block-Based Gradient Domain High Dynamic Range Compression Design for Real-Time Applications , 2007, 2007 IEEE International Conference on Image Processing.

[10]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[11]  Firas Hassan,et al.  Real-time embedded algorithms for local tone mapping of high dynamic range images , 2007 .

[12]  Michael Kazhdan,et al.  Streaming multigrid for gradient-domain operations on large images , 2008, SIGGRAPH 2008.

[13]  Hans-Peter Seidel,et al.  Perceptual effects in real-time tone mapping , 2005, SCCG '05.

[14]  Firas Hassan,et al.  Exploiting redundancy to solve the Poisson equation using local information , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[15]  Nancy S. Pollard,et al.  Real-time gradient-domain painting , 2008, ACM Trans. Graph..

[16]  Szymon Rusinkiewicz,et al.  Multiscale shape and detail enhancement from multi-light image collections , 2007, ACM Trans. Graph..

[17]  Edward H. Adelson,et al.  PYRAMID METHODS IN IMAGE PROCESSING. , 1984 .

[18]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[19]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[20]  J. E. Glynn,et al.  Numerical Recipes: The Art of Scientific Computing , 1989 .

[21]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[22]  Mark S. Drew,et al.  Removing Shadows from Images , 2002, ECCV.

[23]  Rong Yang,et al.  Design optimization of a global/local tone mapping processor on arm SOC platform for real-time high dynamic range video , 2008, 2008 15th IEEE International Conference on Image Processing.

[24]  Ramesh Raskar,et al.  Removing photography artifacts using gradient projection and flash-exposure sampling , 2005, ACM Trans. Graph..

[25]  Luís Paulo Santos,et al.  A local model of eye adaptation for high dynamic range images , 2004, AFRIGRAPH '04.

[26]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[27]  Gilbert Strang,et al.  Introduction to applied mathematics , 1988 .

[28]  Firas Hassan,et al.  An FPGA-based architecture for a local tone-mapping operator , 2007, Journal of Real-Time Image Processing.

[29]  Mark D. Fairchild,et al.  Meet iCAM: A Next-Generation Color Appearance Model , 2002, Color Imaging Conference.

[30]  Mark D. Fairchild,et al.  Meet iCAM: An Image Color Appearance Model , 2008 .

[31]  Jack Tumblin,et al.  The Trilateral Filter for High Contrast Images and Meshes , 2003, Rendering Techniques.

[32]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .