Real-time Visualization of High-Dynamic-Range Infrared Images based on Human Perception Characteristics - Noise Removal, Image Detail Enhancement and Time Consistency

This paper presents an image detail enhancement and noise removal method that accounts for the limitations on human’s perception to effectively visualize high-dynamic-range (HDR) infrared (IR) images. In order to represent real world scenes, IR images use to be represented by a HDR that generally exceeds the working range of common display devices (8 bits). Therefore, an effective HDR compression without loosing the perceptibility of details is needed. We herein propose a practical approach to effectively map raw IR images to 8 bit data representation. To do so, we propose an image processing pipeline based on two main steps. First, the raw IR image is split into base and detail image components using the guided filter (GF). The base image corresponds to the resulting edge-preserving smoothed image. The detail image results from the difference between the raw and base images, which is further masked using the linear coefficients of the GF, an indicator of the spatial detail. Then, we filter the working range of the HDR along time to avoid global brightness fluctuations in the final 8 bit data representation, which results from combining both detail and base image components using a local adaptive gamma correction (LAGC). The last has been designed according to the human vision characteristics. The experimental evaluation shows that the proposed approach significantly enhances image details in addition to improving the contrast of the entire image. Finally, the high performance of the proposed approach makes it suitable for real word applications.

[1]  Carl Salvaggio,et al.  Quantitative analysis of infrared contrast enhancement algorithms , 2007, SPIE Defense + Commercial Sensing.

[2]  Jerry Silverman,et al.  Signal-processing algorithms for display and enhancement of IR images , 1993, Optics & Photonics.

[3]  Bo Zhou,et al.  A new adaptive contrast enhancement algorithm for infrared images based on double plateaus histogram equalization , 2012 .

[4]  김정연,et al.  서브블록 히스토그램 등화기법을 이용한 개선된 콘트래스트 강화 알고리즘 ( An Advanced Contrast Enhancement Using Partially Overlapped Sub-Block Histogram Equalization ) , 1999 .

[5]  Tayfun Aytac,et al.  Adaptive enhancement of infrared images containing sea surface targets , 2010, 2010 IEEE 18th Signal Processing and Communications Applications Conference.

[6]  Paul S. Heckbert,et al.  Graphics gems IV , 1994 .

[7]  Xiubao Sui,et al.  Display and detail enhancement for high-dynamic-range infrared images , 2011 .

[8]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[9]  Ning Liu,et al.  Detail enhancement for high-dynamic-range infrared images based on guided image filter , 2014 .

[10]  Xia Wang,et al.  Infrared image detail enhancement based on local adaptive gamma correction , 2012 .

[11]  Virgil E. Vickers,et al.  Plateau equalization algorithm for real-time display of high-quality infrared imagery , 1996 .

[12]  Marco Diani,et al.  New technique for the visualization of high dynamic range infrared images , 2009 .

[13]  Sos S. Agaian,et al.  Transform-based image enhancement algorithms with performance measure , 2001, IEEE Trans. Image Process..

[14]  Marco Diani,et al.  Dynamic-range compression and contrast enhancement in infrared imaging systems , 2008 .

[15]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[16]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[17]  Gary R. Bradski,et al.  Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library , 2016 .

[18]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .