A Method of Sky Ripple Residual Nonuniformity Reduction for a Cooled Infrared Imager and Hardware Implementation

Cooled infrared detector arrays always suffer from undesired ripple residual nonuniformity (RNU) in sky scene observations. The ripple residual nonuniformity seriously affects the imaging quality, especially for small target detection. It is difficult to eliminate it using the calibration-based techniques and the current scene-based nonuniformity algorithms. In this paper, we present a modified temporal high-pass nonuniformity correction algorithm using fuzzy scene classification. The fuzzy scene classification is designed to control the correction threshold so that the algorithm can remove ripple RNU without degrading the scene details. We test the algorithm on a real infrared sequence by comparing it to several well-established methods. The result shows that the algorithm has obvious advantages compared with the tested methods in terms of detail conservation and convergence speed for ripple RNU correction. Furthermore, we display our architecture with a prototype built on a Xilinx Virtex-5 XC5VLX50T field-programmable gate array (FPGA), which has two advantages: (1) low resources consumption; and (2) small hardware delay (less than 10 image rows). It has been successfully applied in an actual system.

[1]  Li-Xin Wang Stable adaptive fuzzy control of nonlinear systems , 1993, IEEE Trans. Fuzzy Syst..

[2]  Guohua Gu,et al.  Space low-pass and temporal high-pass nonuniformity correction algorithm , 2010 .

[3]  Abraham Friedenberg,et al.  Nonuniformity two-point linear correction errors in infrared focal plane arrays , 1998 .

[4]  Kyuman Cho,et al.  Nonuniformity correction scheme for an infrared camera including the background effect due to camera temperature variation , 2000 .

[5]  Russell C Hardie,et al.  Scene-based nonuniformity correction with reduced ghosting using a gated LMS algorithm. , 2009, Optics express.

[6]  Yuncai Wang,et al.  Enhancing the Brightness of Quantum Dot Light-Emitting Diodes by Multilayer Heterostructures , 2016, IEEE Photonics Journal.

[7]  Baojun Zhao,et al.  Robust Approach for Nonuniformity Correction in Infrared Focal Plane Array , 2016, Sensors.

[8]  Jorge E. Pezoa,et al.  Embedded nonuniformity correction in infrared focal plane arrays using the Constant Range algorithm , 2015 .

[9]  E. Dereniak,et al.  Linear theory of nonuniformity correction in infrared staring sensors , 1993 .

[10]  Miguel Figueroa,et al.  FPGA-based Neural Network for Nonuniformity Correction on Infrared Focal Plane Arrays , 2012, 2012 15th Euromicro Conference on Digital System Design.

[11]  Shimshon N. Lashansky,et al.  Segmentation and statistical analysis of ground-based infrared cloudy sky images , 1992 .

[12]  Xingbin Zeng,et al.  Classification of Clouds in Satellite Imagery Using Adaptive Fuzzy Sparse Representation , 2016, Sensors.

[13]  John G. Harris,et al.  Minimizing the ghosting artifact in scene-based nonuniformity correction , 1998, Defense, Security, and Sensing.

[14]  Dominique Ginhac,et al.  Scene-based non-uniformity correction: From algorithm to implementation on a smart camera , 2013, J. Syst. Archit..

[15]  Ming Shao,et al.  Study on the infrared radiation characteristics of the sky background , 2015, Applied Optics and Photonics China.

[16]  John G. Harris,et al.  Nonuniformity correction of infrared image sequences using the constant-statistics constraint , 1999, IEEE Trans. Image Process..

[17]  Sergio N. Torres,et al.  Fast Adaptive Nonuniformity Correction for Infrared Focal-Plane Array Detectors , 2005, EURASIP J. Adv. Signal Process..

[18]  Ajay Kumar,et al.  A novel algorithm and FPGA based adaptable architecture for correcting sensor non-uniformities in infrared system , 2007, Microprocess. Microsystems.

[19]  Shimshon N. Lashansky,et al.  Preprocessing of ground-based infrared sky images to obtain the true statistical behavior of the image , 1991 .

[20]  Melvin R. Kruer,et al.  Adaptive retina-like preprocessing for imaging detector arrays , 1993, IEEE International Conference on Neural Networks.

[21]  Tianxu Zhang,et al.  Optics Temperature-Dependent Nonuniformity Correction Via $\ell _{0}$-Regularized Prior for Airborne Infrared Imaging Systems , 2016, IEEE Photonics Journal.

[22]  Shuo Li,et al.  Temporal high-pass non-uniformity correction algorithm based on grayscale mapping and hardware implementation , 2015, International Conference on Optical Instruments and Technology.

[23]  Xu Zhang,et al.  An Adaptive Deghosting Method in Neural Network-Based Infrared Detectors Nonuniformity Correction , 2018, Sensors.

[24]  Zhe Liu,et al.  A combined temporal and spatial deghosting technique in scene based nonuniformity correction , 2015 .

[25]  E Armstrong,et al.  Scene-based nonuniformity correction with video sequences and registration. , 2000, Applied optics.