An algebraic restoration method for estimating fixed-pattern noise in infrared imagery from a video sequence

The inherent nonuniformity in the photoresponse and readout-circuitry of the individual detectors in infrared focal-plane-array imagers result in the notorious fixed-pattern noise (FPN). FPN generally degrades the performance of infrared imagers and it is particularly problematic in the midwavelength and longwavelength infrared regimes. In many applications, employing signal-processing techniques to combat FPN may be preferred over hard calibration (e.g., two-point calibration), as they are less expensive and, more importantly, do not require halting the operation of the camera. In this paper, a new technique that uses knowledge of global motion in a video sequence to restore the true scene in the presence of FPN is introduced. In the proposed setting, the entire video sequence is regarded as an output of a motion-dependent linear transformation, which acts collectively on the true scene and the unknown bias elements (which represent the FPN) in each detector. The true scene is then estimated from the video sequence according to a minimum mean-square-error criterion. Two modes of operation are considered. First, we consider non-radiometric restoration, in which case the true scene is estimated by performing a regularized minimization, since the problem is ill-posed. The other mode of operation is radiometric, in which case we assume that only the perimeter detectors have been calibrated. This latter mode does not require regularization and therefore avoids compromising the radiometric accuracy of the restored scene. The algorithm is demonstrated through preliminary results from simulated and real infrared imagery.

[1]  David S. Watkins,et al.  Fundamentals of matrix computations , 1991 .

[2]  P. M. Narendra Reference-Free Nonuniformity Compensation For IR Imaging Arrays , 1980, Optics & Photonics.

[3]  N. A. Foss,et al.  Shutterless Fixed Pattern Noise Correction For Infrared Imaging Arrays , 1981, Other Conferences.

[4]  E Armstrong,et al.  Scene-based nonuniformity correction with video sequences and registration. , 2000, Applied optics.

[5]  Majeed M. Hayat,et al.  Algebraic scene-based nonuniformity correction in focal plane arrays , 2001, SPIE Defense + Commercial Sensing.

[6]  M. Kruer,et al.  Influence Of Nonuniformity On Infrared Focal Plane Array Performance , 1985 .

[7]  J. Scott Tyo,et al.  Radiometrically calibrated scene-based nonuniformity correction for infrared array sensors , 2003, SPIE Optics + Photonics.

[8]  Jonathan Martin Mooney,et al.  Responsivity Nonuniformity Limited Performance Of Infrared Staring Cameras , 1989 .

[9]  John G. Harris,et al.  Continuous-time calibration of VLSI sensors for gain and offset variations , 1995, Defense, Security, and Sensing.

[10]  C. G. Broyden Large Sparse Sets of Linear Equations , 1972 .

[11]  Bradley M. Ratliff,et al.  An algebraic algorithm for nonuniformity correction in focal-plane arrays. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[12]  William F. O'Neil Dithered scan detector compensation , 1992, Infrared Information Symposia.

[13]  J. Scott Tyo,et al.  Algorithm for radiometrically accurate nonuniformity correction with arbitrary scene motion , 2003, SPIE Defense + Commercial Sensing.

[14]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[15]  E. Dereniak,et al.  Linear theory of nonuniformity correction in infrared staring sensors , 1993 .

[16]  Stephen C. Cain,et al.  Model-based real-time nonuniformity correction in focal plane array detectors , 1998, Defense, Security, and Sensing.

[17]  M M Hayat,et al.  Statistical algorithm for nonuniformity correction in focal-plane arrays. , 1999, Applied optics.

[18]  J. Scott Tyo,et al.  On the performance of a radiometrically-calibrated nonuni-formity correction algorithm , 2002 .

[19]  I. Duff Sparse Matrices and Their Uses. , 1983 .

[20]  Edward A. Watson,et al.  High-Resolution Image Reconstruction from a Sequence of Rotated and Translated Frames and its Application to an Infrared Imaging System , 1998 .

[21]  J Scott Tyo,et al.  Radiometrically accurate scene-based nonuniformity correction for array sensors. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[22]  John G. Harris,et al.  Minimizing the ghosting artifact in scene-based nonuniformity correction , 1998, Defense, Security, and Sensing.

[23]  Bradley Michael Ratliff An algebraic scene-based algorithm for nonuniformity correction in focal plane arrays , 2001 .