DenseHashNet: A Novel Deep Hashing for Medical Image Retrieval

With the wide application of imaging modalities such as X-ray and Computed Tomography (CT) in clinical practice, Content-based Medical Image Retrieval (CBMIR) has become a current research hotspot. Related studies have shown that hash-based image retrieval algorithms can retrieve relevant images faster and more accurately than traditional image retrieval methods. Therefore, in this paper, we propose a novel deep hashing method for medical image retrieval, called DenseHashNet. Specifically, we first use DenseNet to extract the original image features, and introduce the Spatial Pyramid Pooling (SPP) layer after the last Dense Block so that features at different scales can be extracted and multi-scale features fused with information from multiple regions. Then, the output of the SPP layer is subjected to Power-Mean Transformation (PMT) operation to enhance the nonlinearity of the model and improve the performance of the model. Finally, we map the output of PMT to hash codes through fully connected layers. Experimental results show that our method achieves better performance, compared with some representative methods.

[1]  Yansheng Li,et al.  Image retrieval from remote sensing big data: A survey , 2021, Inf. Fusion.

[2]  Jiang Liu,et al.  Deep triplet hashing network for case-based medical image retrieval. , 2021, Medical image analysis.

[3]  Jiang Liu,et al.  Attention-based Saliency Hashing for Ophthalmic Image Retrieval , 2020, 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[4]  Xiangtao Zheng,et al.  Deep balanced discrete hashing for image retrieval , 2020, Neurocomputing.

[5]  Hao Zhang,et al.  A Survey on Deep Hashing Methods , 2020, ACM Trans. Knowl. Discov. Data.

[6]  Jianxin Wu,et al.  Improving CNN linear layers with power mean non-linearity , 2019, Pattern Recognit..

[7]  Xiaofei Wang,et al.  Similarity-preserving hashing based on deep neural networks for large-scale image retrieval , 2019, J. Vis. Commun. Image Represent..

[8]  Lin Yang,et al.  Pairwise based deep ranking hashing for histopathology image classification and retrieval , 2018, Pattern Recognit..

[9]  Song Wang,et al.  Improved Deep Hashing With Soft Pairwise Similarity for Multi-Label Image Retrieval , 2018, IEEE Transactions on Multimedia.

[10]  Wu-Jun Li,et al.  Asymmetric Deep Supervised Hashing , 2017, AAAI.

[11]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[12]  Muhammad Awais,et al.  Medical image retrieval using deep convolutional neural network , 2017, Neurocomputing.

[13]  Yan Gao,et al.  A new method of content based medical image retrieval and its applications to CT imaging sign retrieval , 2017, J. Biomed. Informatics.

[14]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  M. S. Meharban,et al.  A Review on Image Retrieval Techniques , 2016 .

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Wu-Jun Li,et al.  Feature Learning Based Deep Supervised Hashing with Pairwise Labels , 2015, IJCAI.

[18]  Dimitris N. Metaxas,et al.  Computer-Aided Diagnosis of Mammographic Masses Using Scalable Image Retrieval , 2015, IEEE Transactions on Biomedical Engineering.

[19]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Svetlana Lazebnik,et al.  Iterative quantization: A procrustean approach to learning binary codes , 2011, CVPR 2011.

[21]  Wu-Jun Li,et al.  Isotropic Hashing , 2012, NIPS.

[22]  Haejun Lee,et al.  Medical Image Retrieval: Past and Present , 2012, Healthcare informatics research.

[23]  Antonio Torralba,et al.  Spectral Hashing , 2008, NIPS.