A time-domain projection-based registration-scene-based nonuniformity correction technology and its detailed hardware realization

Non-uniformity (NU) in infrared images can cause great degradation of the image quality and appearance. Scene-based nonuniformity correction (SBNUC) has become a very effective way to deal with NU. Although many SBNUC methods have been developed by researchers worldwide, few of them have a good correction performance and can be applied to small-package real-time devices. In this paper, we propose a time-domain projection-based registrationscene-based NU correction technology and its detailed hardware realization. We developed a new projection estimator to calculate the relative displacement of neighboring frames. The estimator uses a column and row projection vector to calculate the displacement separately without reducing the accuracy. We also developed an improved gain coefficient correction method using the corrected bias coefficient to correct the gain coefficient by clarifying the intrinsic relationship between these two coefficients instead of correcting them separately. We have also thoroughly analyzed how this technology performs with an actual infrared video sequence containing both low-frequency and high-frequency NUs. The hardware realization of this technology in a single-FPGA-core real-time system is also described in detail. We have successfully realized this technology in a real engineering application. Detailed flow charts for the hardware implementation of this algorithm are also provided.

[1]  Qian Chen,et al.  Improved interframe registration based nonuniformity correction for focal plane arrays , 2012 .

[2]  Sergio N. Torres,et al.  Fast Adaptive Nonuniformity Correction for Infrared Focal-Plane Array Detectors , 2005, EURASIP J. Adv. Signal Process..

[3]  Guohua Gu,et al.  New temporal high-pass filter nonuniformity correction based on bilateral filter , 2011 .

[4]  Sergio N. Torres,et al.  Adaptive scene-based nonuniformity correction method for infrared-focal plane arrays , 2003, SPIE Defense + Commercial Sensing.

[5]  M M Hayat,et al.  Statistical algorithm for nonuniformity correction in focal-plane arrays. , 1999, Applied optics.

[6]  Xiubao Sui,et al.  Registration method for infrared images under conditions of fixed-pattern noise , 2012 .

[7]  J Scott Tyo,et al.  Radiometrically accurate scene-based nonuniformity correction for array sensors. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[8]  Melvin R. Kruer,et al.  Adaptive nonuniformity correction for IR focal-plane arrays using neural networks , 1991, Optics & Photonics.

[9]  Marco Diani,et al.  A comparison of deghosting techniques in adaptive nonuniformity correction for IR focal-plane array systems , 2010, Security + Defence.

[10]  Melvin R. Kruer,et al.  Nonuniformity correction for staring IR focal plane arrays using scene-based techniques , 1990, Defense, Security, and Sensing.

[11]  J Scott Tyo,et al.  Generalized algebraic scene-based nonuniformity correction algorithm. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[12]  Guohua Gu,et al.  Space low-pass and temporal high-pass nonuniformity correction algorithm , 2010 .

[13]  Hong Zhu,et al.  Scene-based nonuniformity correction technique for infrared focal-plane arrays. , 2009, Applied optics.

[14]  Qian Chen,et al.  Adaptive convergence nonuniformity correction algorithm. , 2011, Applied optics.

[15]  Xiubao Sui,et al.  Scene-based nonuniformity correction algorithm based on interframe registration. , 2011, Journal of the Optical Society of America. A, Optics, image science, and vision.

[16]  Bradley M. Ratliff,et al.  An algebraic algorithm for nonuniformity correction in focal-plane arrays. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[17]  Marco Diani,et al.  Temporal statistics de-ghosting for adaptive non-uniformity correction in infrared focal plane arrays , 2010 .

[18]  John G. Harris,et al.  Nonuniformity correction using the constant-statistics constraint: analog and digital implementations , 1997, Defense, Security, and Sensing.

[19]  John G. Harris,et al.  Minimizing the ghosting artifact in scene-based nonuniformity correction , 1998, Defense, Security, and Sensing.

[20]  Xiubao Sui,et al.  Scene-based nonuniformity correction method using multiscale constant statistics , 2011 .

[21]  Qian Chen,et al.  A two-frame approach for scene-based nonuniformity correction in array sensors , 2013 .