Enhancement of Bright Video Features for HDR Displays

To utilize the full potential of new high dynamic range (HDR) displays, a system for the enhancement of bright luminous objects in video sequences is proposed. The system classifies clipped (saturated) regions as lights, reflections or diffuse surfaces using a semi‐automatic classifier and then enhances each class of objects with respect to its relative brightness. The enhancement algorithm can significantly stretch the contrast of clipped regions while avoiding amplification of noise and contouring. We demonstrate that the enhanced video is strongly preferred to non‐enhanced video, and it compares favorably to other methods.

[1]  Heiko Neumann,et al.  Sketching shiny surfaces: 3D shape extraction and depiction of specular surfaces , 2006, TAP.

[2]  H BülthoffHeinrich,et al.  Do HDR displays support LDR content , 2007 .

[3]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997, SIGGRAPH '97.

[4]  Alan Chalmers,et al.  Evaluation of tone mapping operators using a High Dynamic Range display , 2005, ACM Trans. Graph..

[5]  Wolfgang Heidrich,et al.  Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs , 2007, ACM Trans. Graph..

[6]  Erik Reinhard,et al.  Do HDR displays support LDR content?: a psychophysical evaluation , 2007, SIGGRAPH 2007.

[7]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[8]  Xuemei Zhang,et al.  Estimation of saturated pixel values in digital color imaging. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Wolfgang Heidrich,et al.  High dynamic range display systems , 2004, ACM Trans. Graph..

[10]  Stephen Lin,et al.  Highlight removal by illumination-constrained inpainting , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[11]  Wolfgang Heidrich,et al.  Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs , 2007, SIGGRAPH 2007.

[12]  Scott J. Daly,et al.  Bit-depth extension using spatiotemporal microdither based on models of the equivalent input noise of the visual system , 2003, IS&T/SPIE Electronic Imaging.

[13]  Stephen Lin,et al.  Radiometric calibration from a single image , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[14]  Erik Reinhard,et al.  Do HDR displays support LDR content?: a psychophysical evaluation , 2007, ACM Trans. Graph..

[15]  Kun Zhou,et al.  High dynamic range image hallucination , 2007, SIGGRAPH '07.

[16]  Francesco Banterle,et al.  Inverse tone mapping , 2006, GRAPHITE '06.

[17]  Jianhong Shen,et al.  Inpainting and the Fundamental Problem of Image Processing , 2002 .

[18]  Laurence Meylan,et al.  The Reproduction of Specular Highlights on High Dynamic Range Displays , 2006, CIC.

[19]  Scott J. Daly,et al.  Decontouring: prevention and removal of false contour artifacts , 2004, IS&T/SPIE Electronic Imaging.

[20]  Bobby R. Hunt,et al.  Bayesian Methods in Nonlinear Digital Image Restoration , 1977, IEEE Transactions on Computers.

[21]  FlemingRoland,et al.  Sketching shiny surfaces , 2006 .

[22]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[23]  Tomas Olofsson,et al.  Deconvolution and model-based restoration of clipped ultrasonic signals , 2005, IEEE Transactions on Instrumentation and Measurement.

[24]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[25]  Hany Farid,et al.  Blind inverse gamma correction , 2001, IEEE Trans. Image Process..

[26]  Heung-Yeung Shum,et al.  Radiometric calibration from a single image , 2004, CVPR 2004.

[27]  Katja Doerschner,et al.  Illumination estimation in three-dimensional scenes with and without specular cues. , 2005, Journal of vision.

[28]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[29]  Laurence Meylan,et al.  Tone mapping for high dynamic range displays , 2007, Electronic Imaging.

[30]  Julius O. Smith,et al.  Restoring a clipped signal , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[31]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[32]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[33]  Sitaram Bhagavathy,et al.  Multi-Scale Probabilistic Dithering for Suppressing Banding Artifacts in Digital Images , 2007, 2007 IEEE International Conference on Image Processing.