A pipelined architecture for real time correction of non-uniformity in infrared focal plane arrays imaging system using multiprocessors

Abstract This paper proposes a kind of pipelined electric circuit architecture implemented in FPGA, a very large scale integrated circuit (VLSI), which efficiently deals with the real time non-uniformity correction (NUC) algorithm for infrared focal plane arrays (IRFPA). Dual Nios II soft-core processors and a DSP with a 64+ core together constitute this image system. Each processor undertakes own systematic task, coordinating its work with each other’s. The system on programmable chip (SOPC) in FPGA works steadily under the global clock frequency of 96Mhz. Adequate time allowance makes FPGA perform NUC image pre-processing algorithm with ease, which has offered favorable guarantee for the work of post image processing in DSP. And at the meantime, this paper presents a hardware (HW) and software (SW) co-design in FPGA. Thus, this systematic architecture yields an image processing system with multiprocessor, and a smart solution to the satisfaction with the performance of the system.

[1]  Chao Zhang,et al.  Efficient Scene-based Nonuniformity Correction and Enhancement , 2006, 2006 International Conference on Image Processing.

[2]  Ajay Kumar,et al.  Correcting Infrared Focal Plane Array Sensor Non Uniformities Based Upon Adaptive Filter , 2006, 2006 International Conference on Image Processing.

[3]  Majeed M. Hayat,et al.  Algebraic scene-based nonuniformity correction in focal plane arrays , 2001, SPIE Defense + Commercial Sensing.

[4]  Lei Wang,et al.  Scene-based Nonunifomity Correction Algorithm for Infrared Focal Plane Arrays , 2006, 2006 Joint 31st International Conference on Infrared Millimeter Waves and 14th International Conference on Teraherz Electronics.

[5]  Robert A. Leathers,et al.  Scene-based Nonuniformity Correction and Bad-pixel Identification for Hyperspectral VNIR/SWIR Sensors , 2006, 2006 IEEE International Symposium on Geoscience and Remote Sensing.

[6]  P. M. Narendra Scene-Based Nonuniformity Compensation for Imaging Sensors , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  John G. Harris,et al.  Nonuniformity correction of infrared image sequences using the constant-statistics constraint , 1999, IEEE Trans. Image Process..

[8]  R. E. Vera,et al.  Ghosting reduction in adaptive nonuniformity correction of infrared focal-plane array image sequences , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[9]  Hussein Baher,et al.  Analog & digital signal processing , 1990 .

[10]  Haitao Liu,et al.  Two-point Multi-Section Nonuniformity Correction Algorithm of Infrared Image And Implementation of Its Simulation Platform , 2006, 2006 IEEE International Conference on Information Acquisition.

[11]  E Armstrong,et al.  Scene-based nonuniformity correction with video sequences and registration. , 2000, Applied optics.

[12]  T.H. Kelly Non-uniformity correction and calibration of a portable infrared scene projector , 2002, Proceedings, IEEE AUTOTESTCON.

[13]  A.D. Fischer,et al.  Stable Scene-based Non-uniformity Correction Coefficients for Hyperspectral SWIR Sensors , 2007, 2007 IEEE Aerospace Conference.

[14]  Yuan Xian-hui Infrared Real-time Thermal System Based on DSP , 2001 .

[15]  Qing Li,et al.  A new real-time processing system for the IRFPA imaging signal based on DSP&FPGA , 2005 .

[16]  O. Kuybeda,et al.  Robust nonuniformity correction in infrared images based on global motion , 2008, 2008 IEEE 25th Convention of Electrical and Electronics Engineers in Israel.

[17]  G. De Jager,et al.  Reference free nonuniformity correction for mercury cadmium telluride infrared focal plane arrays , 1998, Proceedings of the 1998 South African Symposium on Communications and Signal Processing-COMSIG '98 (Cat. No. 98EX214).

[18]  R.E. Eck On-chip signal processing to overcome IR detector nonuniformities , 1976, 1976 International Electron Devices Meeting.

[19]  Charles A. Marshall,et al.  Uncooled infrared sensor with digital focal plane array for medical applications , 1996, Proceedings of 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Gert Cauwenberghs,et al.  Floating-gate adaptation for focal-plane online nonuniformity correction , 2001 .

[21]  Rui Lai,et al.  Nonuniformity correction algorithm based on wavelet transform for infrared focal plane arrays , 2007, 2007 Joint 32nd International Conference on Infrared and Millimeter Waves and the 15th International Conference on Terahertz Electronics.

[22]  Chih-Cheng Hsieh,et al.  Focal-plane-arrays and CMOS readout techniques of infrared imaging systems , 1997, IEEE Trans. Circuits Syst. Video Technol..

[23]  Weiqi Jin,et al.  A scene-based nonuniformity correction technique for IRFPA using perimeter diaphragm strips , 2005, Proceedings. 2005 International Conference on Communications, Circuits and Systems, 2005..

[24]  Rui Lai,et al.  Adaptive filtering for nonuniformity correction in infrared focal plane arrays , 2007, 2007 Joint 32nd International Conference on Infrared and Millimeter Waves and the 15th International Conference on Terahertz Electronics.

[25]  Yongjin Liu,et al.  New Scene-Based Nonuniformity Correction Algorithm of Infrared Focal-Plane Arrays , 2007, 2007 5th International Symposium on Image and Signal Processing and Analysis.

[26]  Lester J. Kozlowski,et al.  LWIR 128*128 GaAs/AlGaAs multiple quantum well hybrid focal plane array , 1991 .

[27]  Gert Cauwenberghs,et al.  Focal-plane on-line nonuniformity correction using floating-gate adaptation , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[28]  C.S. Martin,et al.  An Effective Reference-Free Performance Metric for Non-uniformity Correction Algorithms in Infrared Imaging System , 2007, LEOS 2007 - IEEE Lasers and Electro-Optics Society Annual Meeting Conference Proceedings.

[29]  Ajay Kumar,et al.  A novel algorithm and FPGA based adaptable architecture for correcting sensor non-uniformities in infrared system , 2007, Microprocess. Microsystems.

[30]  Wang Jingzhong,et al.  Development of Infrared Real-time Imaging System Based on SOPC , 2008 .

[31]  Vijayan K. Asari,et al.  A pipelined architecture for real-time correction of barrel distortion in wide-angle camera images , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Chengxiang Liu,et al.  An Improved Nonuniformity Correction Algorithm for Infrared Focal Plane Arrays , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[33]  Chen Sihai,et al.  Analysis of the residual error after nonuniformity correction for infrared focal plane array , 2000, 25th International Conference on Infrared and Millimeter Waves (Cat. No.00EX442).