Video Enhancement and Dynamic Range Control of HDR Sequences for Automotive Applications

CMOS video cameras with high dynamic range (HDR) output are particularly suitable for driving assistance applications, where lighting conditions can strongly vary, going from direct sunlight to dark areas in tunnels. However, common visualization devices can only handle a low dynamic range, and thus a dynamic range reduction is needed. Many algorithms have been proposed in the literature to reduce the dynamic range of still pictures. Anyway, extending the available methods to video is not straightforward, due to the peculiar nature of video data. We propose an algorithm for both reducing the dynamic range of video sequences and enhancing its appearance, thus improving visual quality and reducing temporal artifacts. We also provide an optimized version of our algorithm for a viable hardware implementation on an FPGA. The feasibility of this implementation is demonstrated by means of a case study.

[1]  Michael Ashikhmin,et al.  A Tone Mapping Algorithm for High Contrast Images , 2002, Rendering Techniques.

[2]  Giovanni Ramponi,et al.  Adaptive reduction of the dynamics of HDR video sequences , 2005, IEEE International Conference on Image Processing 2005.

[3]  Leonard McMillan,et al.  Video enhancement using per-pixel virtual exposures , 2005, ACM Trans. Graph..

[4]  Narendra Ahuja,et al.  High Dynamic Range Video Using Split Aperture Camera , 2005 .

[5]  Donald P. Greenberg,et al.  Time-dependent visual adaptation for fast realistic image display , 2000, SIGGRAPH.

[6]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[7]  S. Marsi,et al.  Image contrast enhancement using a recursive rational filter , 2004, 2004 IEEE International Workshop on Imaging Systems and Techniques (IST) (IEEE Cat. No.04EX896).

[8]  Carlo Gatta,et al.  From Retinex to Automatic Color Equalization: issues in developing a new algorithm for unsupervised color equalization , 2004, J. Electronic Imaging.

[9]  Greg Turk,et al.  LCIS: a boundary hierarchy for detail-preserving contrast reduction , 1999, SIGGRAPH.

[10]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[11]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[12]  S. Kavadias,et al.  A logarithmic response CMOS image sensor with on-chip calibration , 2000, IEEE Journal of Solid-State Circuits.

[13]  Hiroaki Kotera,et al.  Dynamic range compression preserving local image contrast for digital video camera , 2005, IEEE Transactions on Consumer Electronics.

[14]  G. Ward,et al.  54.2: A High Dynamic Range Display Using Low and High Resolution Modulators , 2003 .

[15]  Wim A. G. Timmers,et al.  40.5L: Late‐News Paper: 18.1‐inch XGA TFT‐LCD with Wide Color Reproduction using High Power LED‐Backlighting , 2002 .

[16]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[17]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[18]  Charles Hansen,et al.  Adaptive temporal tone mapping , 2004 .

[19]  Glenn D. Hines,et al.  DSP implementation of the retinex image enhancement algorithm , 2004, SPIE Defense + Commercial Sensing.

[20]  Wolfgang Heidrich,et al.  High dynamic range display systems , 2004, ACM Trans. Graph..

[21]  Sumanta N. Pattanaik,et al.  Adaptive gain control for high dynamic range image display , 2002, SCCG '02.

[22]  Michael Wimmer,et al.  Delivering Interactivity to Complex Tone Mapping Operators , 2003, Rendering Techniques.

[23]  Richard Szeliski,et al.  High dynamic range video , 2003, ACM Trans. Graph..

[24]  Nebojsa Jojic,et al.  Probability models for high dynamic range imaging , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[25]  Luís Paulo Santos,et al.  A local model of eye adaptation for high dynamic range images , 2004, AFRIGRAPH '04.

[26]  Mario Fernando Montenegro Campos,et al.  A video-based support system for nighttime navigation in semi-structured environments , 2004, Proceedings. 17th Brazilian Symposium on Computer Graphics and Image Processing.

[27]  Hans-Peter Seidel,et al.  Perceptual effects in real-time tone mapping , 2005, SCCG '05.