Wavelength diversity based infrared super-resolution and condition-based maintenance

The relevance of image sequence super-resolution (SR or high resolution (HR)) and wavelength diversity to encompass IR imaging for condition-based maintenance (CBM) of complex systems was pointed out last June at the previous Forum at Harrogate in 2007. In CBM, non-contact analysis of plant condition to faulty components (fuses, bearings, motors, steam pipes, gears, belts) can prevent costly shutdowns by corrective maintenance and breakdown prediction to enable pre-emptive action. Since HR infrared cameras are very expensive, digital super-resolution techniques can be used to create an HR image from low cost low-resolution (LR) images. Wavelength diversity spans the range from ultraviolet (0.1 microns) to infrared (1-100 microns). Thermal IR (infrared) images are focal plane IR detector (bolometer) array and lens combinations that give a visual representation of IR energy emitted. Thermal IR images can passively see all objects regardless of ambient light and thermography can give detailed images of invisible objects. IR thermography is safe, non-intrusive and efficient for identifying faults and overheating components. Images gathered by an array ofIR detectors (staring array, microscanning array) are inherently of limited resolution because of the constraints on the size of the pixels and geometry of the array. Trade-off between energy gathering capability and noise is required, especially because of the particular characteristics of IR image sequence acquisition including the presence of significant aliasing. This paper presents the super-resolution technique based on moving least squares for IR image sequence super-resolution. Results of super-resolution on simulated sets of undersampled degraded IR images are also presented. A procedure for higher-order whitening in the transmitting end and de-whitening in the receiving end is also considered within the overall framework of thermal image data acquisition, compression, coding and transmission of the data through communication channels followed by de-whitening and image sequence super-resolution at the receiving end.

[1]  Ronald G Driggers,et al.  Characteristics of infrared imaging systems that benefit from superresolution reconstruction. , 2007, Applied optics.

[2]  Michael K. Ng,et al.  A Fast Algorithm for Image Super-Resolution from Blurred Observations , 2006, EURASIP J. Adv. Signal Process..

[3]  Sudhakar Prasad,et al.  Digital superresolution and the generalized sampling theorem. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Nirmal K. Bose,et al.  Superresolution and noise filtering using moving least squares , 2006, IEEE Transactions on Image Processing.

[5]  Wojciech Matusik,et al.  Statistics of Infrared Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  N. K. Bose,et al.  High resolution image formation from low resolution frames using Delaunay triangulation , 2002, IEEE Trans. Image Process..

[7]  Nirmal K. Bose,et al.  Multidimensional Generalized Sampling Theorem for wavelet Based Image Superresolution , 2006, 2006 International Conference on Image Processing.

[8]  Mohammad S. Alam,et al.  Infrared image registration and high-resolution reconstruction using multiple translationally shifted aliased video frames , 2000, IEEE Trans. Instrum. Meas..

[9]  N. K. Bose Miniaturised computational imaging system design for super-resolution, large field-of-view and extended depth-of-field with applications to surveillance, medical imaging, and condition-based maintenance , 2008 .

[10]  Ronald G Driggers,et al.  Superresolution image reconstruction from a sequence of aliased imagery. , 2006, Applied optics.

[11]  Nirmal K. Bose,et al.  High‐resolution image reconstruction with multisensors , 1998, Int. J. Imaging Syst. Technol..

[12]  Jun Li,et al.  Wavelet domain superresolution reconstruction of infrared image sequences , 2001, SPIE Defense + Commercial Sensing.

[13]  Joshua Gluckman,et al.  Higher order whitening of natural images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Nirmal K. Bose,et al.  Design of Large Field-of-View High-Resolution Miniaturized Imaging System , 2007, EURASIP J. Adv. Signal Process..

[15]  John Daugman,et al.  The importance of being random: statistical principles of iris recognition , 2003, Pattern Recognit..

[16]  Christopher W. Tyler,et al.  Occlusions contribute to scaling in natural images , 2001, Vision Research.