Real-time visualization of low contrast targets from high-dynamic range infrared images based on temporal digital detail enhancement filter

Abstract. An image detail enhancement method to effectively visualize low contrast targets in high-dynamic range (HDR) infrared (IR) images is presented regardless of the dynamic range width. In general, high temperature dynamics from real-world scenes used to be encoded in a 12 or 14 bits IR image. However, the limitations of the human visual perception, from which no more than 128 shades of gray are distinguishable, and the 8-bit working range of common display devices make necessary an effective 12/14  bits HDR mapping into the 8-bit data representation. To do so, we propose to independently treat the base and detail image components that result from splitting the IR image using two dedicated guided filters. We also introduce a plausibility mask from which those regions that are prominent to present noise are accurately defined to be explicitly tackled to avoid noise amplification. The final 8-bit data representation results from the combination of the processed detail and base image components and its mapping to the 8-bit domain using an adaptive histogram-based projection approach. The limits of the histogram are accommodated through time in order to avoid global brightness fluctuations between frames. The experimental evaluation shows that the proposed noise-aware approach preserves low contrast details with an overall contrast enhancement of the image. A comparison with widely used HDR mapping approaches and runtime analysis is also provided. Furthermore, the proposed mathematical formulation enables a real-time adjustment of the global contrast and brightness, letting the operator adapt to the visualization display device without nondesirable artifacts.

[1]  Xia Wang,et al.  Infrared image detail enhancement based on local adaptive gamma correction , 2012 .

[2]  Kai H. Lee Computers in Nuclear Medicine: A Practical Approach , 1991 .

[3]  Carl Salvaggio,et al.  Quantitative analysis of infrared contrast enhancement algorithms , 2007, SPIE Defense + Commercial Sensing.

[4]  김정연,et al.  서브블록 히스토그램 등화기법을 이용한 개선된 콘트래스트 강화 알고리즘 ( An Advanced Contrast Enhancement Using Partially Overlapped Sub-Block Histogram Equalization ) , 1999 .

[5]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[6]  Marco Diani,et al.  Dynamic-range compression and contrast enhancement in infrared imaging systems , 2008 .

[7]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[8]  Virgil E. Vickers,et al.  Plateau equalization algorithm for real-time display of high-quality infrared imagery , 1996 .

[9]  Ning Liu,et al.  Detail enhancement for high-dynamic-range infrared images based on guided image filter , 2014 .

[10]  Bo Zhou,et al.  A new adaptive contrast enhancement algorithm for infrared images based on double plateaus histogram equalization , 2012 .

[11]  Xiubao Sui,et al.  Display and detail enhancement for high-dynamic-range infrared images , 2011 .

[12]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[13]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[14]  Paul S. Heckbert,et al.  Graphics gems IV , 1994 .

[15]  Marco Diani,et al.  New technique for the visualization of high dynamic range infrared images , 2009 .

[16]  Frederic Garcia,et al.  Noise removal and real-time detail enhancement of high-dynamic-range infrared images with time consistency , 2015, International Conference on Quality Control by Artificial Vision.

[17]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[18]  Jerry Silverman,et al.  Signal-processing algorithms for display and enhancement of IR images , 1993, Optics & Photonics.

[19]  Sos S. Agaian,et al.  Transform-based image enhancement algorithms with performance measure , 2001, IEEE Trans. Image Process..

[20]  Frederic Garcia,et al.  Real-time Visualization of High-Dynamic-Range Infrared Images based on Human Perception Characteristics - Noise Removal, Image Detail Enhancement and Time Consistency , 2015, VISAPP.

[21]  Frederick P. Brooks,et al.  Architecture of the IBM System/360 , 2000, IBM J. Res. Dev..

[22]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .