Image fusion based on multiscale transform and sparse representation to enhance terahertz images.

High-quality terahertz (THz) images are vital to integrated circuit (IC) manufacturing. Due to the unique sensitivity of THz waves to different materials, the images obtained from the point-spread function (PSF) model have fewer image details and less texture information in some frequency bands. This paper presents an image fusion technique to enhance the resolution of THz IC images. The source images obtained from the PSF model are processed by a fusion method combining a multiscale transform (MST) and sparse representation (SR). The low-pass band is handled by sparse representation, and the high-pass band is fused by the conventional "max-absolute" rule. From both objective and visual perspectives, four popular multiscale transforms-the Laplacian pyramid, the ratio of low-pass pyramids, the dual-tree complex wavelet transform and the curvelet transform-are thoroughly compared at different decomposition levels ranging from one to four. This work demonstrates the feasibility of using image fusion to enhance the resolution of THz IC images.

[1]  Michael Elad,et al.  A Plurality of Sparse Representations Is Better Than the Sparsest One Alone , 2009, IEEE Transactions on Information Theory.

[2]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[3]  P. Jepsen,et al.  Radiation patterns from lens-coupled terahertz antennas. , 1995, Optics letters.

[4]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[5]  Stavri G. Nikolov,et al.  Image fusion: Advances in the state of the art , 2007, Inf. Fusion.

[6]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[7]  E. Martin,et al.  Detection of delaminations in sub-wavelength thick multi-layered packages from the local temporal coherence of ultrasonic signals , 2008 .

[8]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[9]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[10]  Zheng Feng,et al.  High‐Performance Photo‐Induced Spatial Terahertz Modulator Based on Micropyramid Silicon Array , 2020, Advanced Materials Technologies.

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Yan Zhang,et al.  Terahertz time-domain spectroscopy for explosive imaging , 2007 .

[13]  Gang Liu,et al.  Performance measure for image fusion considering region information , 2007 .

[14]  Yu Liu,et al.  A general framework for image fusion based on multi-scale transform and sparse representation , 2015, Inf. Fusion.

[15]  Vladislav V. Trofimov,et al.  Resolution enhancing of commercially available passive THz cameras due to computer processing , 2014, Optics & Photonics - Optical Engineering + Applications.

[16]  Kiarash Ahi,et al.  Quality control and authentication of packaged integrated circuits using enhanced-spatial-resolution terahertz time-domain spectroscopy and imaging , 2017 .

[17]  Willie J. Padilla,et al.  All-dielectric metasurface absorbers for uncooled terahertz imaging , 2017 .

[18]  Kiarash Ahi,et al.  Mathematical Modeling of THz Point Spread Function and Simulation of THz Imaging Systems , 2017, IEEE Transactions on Terahertz Science and Technology.

[19]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[20]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[21]  Kiarash Ahi,et al.  A method and system for enhancing the resolution of terahertz imaging , 2019, Measurement.

[22]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[23]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[24]  Shutao Li,et al.  Performance comparison of different multi-resolution transforms for image fusion , 2011, Inf. Fusion.