Fine-grained correlation analysis for medical image retrieval

Abstract Feature fusion in medical image retrieval remains a challenging task because of the high-dimensional data and massive amount of irrelevant information in images. To solve these issues, we propose a novel feature fusion method, called fine-grained correlation analysis (FGCA), for medical image retrieval. First, we analyze the problem that there are many irrelevant local regions in a category. To solve this problem, an image is partitioned into some fine-grained samples. Then, the fine-grained samples with similar characteristics are tagged with the same label by the k-means clustering algorithm. Finally, we investigate how the correlation relationship extracted from the fine-grained samples helps fuse different features and obtain the more discriminative and less redundant information for medical image retrieval. Experiments on three medical image datasets show that our proposed FGCA approach works better than the conventional methods.

[1]  Yicong Zhou,et al.  Prior Knowledge-Based Probabilistic Collaborative Representation for Visual Recognition , 2020, IEEE Transactions on Cybernetics.

[2]  Shengwei Zhao,et al.  Occluded Face Recognition in the Wild by Identity-Diversity Inpainting , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Yan Liu,et al.  A new method of feature fusion and its application in image recognition , 2005, Pattern Recognit..

[4]  Subrahmanyam Murala,et al.  Local Mesh Patterns Versus Local Binary Patterns: Biomedical Image Indexing and Retrieval , 2014, IEEE Journal of Biomedical and Health Informatics.

[5]  Pheng-Ann Heng,et al.  A theorem on the generalized canonical projective vectors , 2005, Pattern Recognit..

[6]  Jian Yang,et al.  Feature fusion: parallel strategy vs. serial strategy , 2003, Pattern Recognit..

[7]  Xiaonan Luo,et al.  A simple texture feature for retrieval of medical images , 2018, Multimedia Tools and Applications.

[8]  Yang Jian Handwritten Character Recognition Based on Parallel Feature Combination and Generalized K-L Expansion , 2003 .

[9]  Xiaonan Luo,et al.  An integrated scattering feature with application to medical image retrieval , 2018, Comput. Electr. Eng..

[10]  Chengjun Liu,et al.  A shape- and texture-based enhanced Fisher classifier for face recognition , 2001, IEEE Trans. Image Process..

[11]  Xinge You,et al.  An adaptive hybrid pattern for noise-robust texture analysis , 2015, Pattern Recognit..

[12]  Gaurav Jaswal,et al.  Multiple feature fusion for unconstrained palm print authentication , 2018, Comput. Electr. Eng..

[13]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Torsten Sattler,et al.  Fine-Grained Segmentation Networks: Self-Supervised Segmentation for Improved Long-Term Visual Localization , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[15]  Fei Long,et al.  Co-regularized multiview nonnegative matrix factorization with correlation constraint for representation learning , 2017, Multimedia Tools and Applications.

[16]  Huan Liu,et al.  Discriminant Analysis for Unsupervised Feature Selection , 2014, SDM.

[17]  Eric A. Hoffman,et al.  Extraction of Airways From CT (EXACT'09) , 2012, IEEE Transactions on Medical Imaging.

[18]  Shiv Ram Dubey,et al.  Local Wavelet Pattern: A New Feature Descriptor for Image Retrieval in Medical CT Databases , 2015, IEEE Transactions on Image Processing.

[19]  Henning Müller,et al.  Large‐scale retrieval for medical image analytics: A comprehensive review , 2018, Medical Image Anal..

[20]  N. Ranganathan,et al.  Gabor filter-based edge detection , 1992, Pattern Recognit..

[21]  Yicong Zhou,et al.  Medical Image Retrieval via Histogram of Compressed Scattering Coefficients , 2017, IEEE Journal of Biomedical and Health Informatics.

[22]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[23]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[24]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.