Modeling clinician medical-knowledge in terms of med-level features for semantic content-based mammogram retrieval

Abstract The huge volume of variability in real-world medical images such as on dimensionality, modality and shape, makes necessary efficient medical image retrieval systems for assisting physicians to perform more accurate diagnoses. However, the major limitation of these systems is the semantic gap, which is the difference between low-level features of images and their high-level semantics in a given situation. This paper deals with this problem and proposes a content-based image retrieval method based on med-level descriptors. These descriptors are automatically generated from low-level image features by exploiting the semantic concepts based on the clinician medical-knowledge. In fact, the proposed method is based on three main steps: (1) low-level feature extraction, (2) med-level model extraction and (3) online retrieval based on med-level feature vectors. The main contributions reside firstly in the integration of clinician medical-knowledge in terms of med-level features without needing radiologists interaction. Secondly, the determination of the query high-level features can be performed through the predicted query med-level descriptors, in addition to retrieve the most relevant images to the query one. Proposed method was validated in the context of mammogram retrieval, on the MIAS dataset, and the results prove its effectiveness and its superiority to the compared methods.

[1]  M Le Gal,et al.  [Diagnostic value of clustered microcalcifications discovered by mammography (apropos of 227 cases with histological verification and without a palpable breast tumor)]. , 1984, Bulletin du cancer.

[2]  Ezzeddine Zagrouba,et al.  Semi-Automated Segmentation of Single and Multiple Tumors in Liver CT Images Using Entropy-Based Fuzzy Region Growing , 2017 .

[3]  Ezzeddine Zagrouba,et al.  Multi-scale Kernel PCA and Its Application to Curvelet-Based Feature Extraction for Mammographic Mass Characterization , 2016, IDA.

[4]  J. Amjath Ali,et al.  Mass Classification in Digital Mammograms based on discrete Shearlet transform , 2013, J. Comput. Sci..

[5]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[6]  Ezzeddine Zagrouba,et al.  Curvelet-based locality sensitive hashing for mammogram retrieval in large-scale datasets , 2015, 2015 IEEE/ACS 12th International Conference of Computer Systems and Applications (AICCSA).

[7]  Rajeev Srivastava,et al.  An efficient content based image retrieval for normal and abnormal mammograms , 2015, 2015 IEEE UP Section Conference on Electrical Computer and Electronics (UPCON).

[8]  Nikolas P. Galatsanos,et al.  A similarity learning approach to content-based image retrieval: application to digital mammography , 2004, IEEE Transactions on Medical Imaging.

[9]  Yue Li,et al.  Mammogram retrieval through machine learning within BI-RADS standards , 2011, J. Biomed. Informatics.

[10]  Sören Häuser,et al.  Fast Finite Shearlet Transform: a tutorial , 2012 .

[11]  Hamid Soltanian-Zadeh,et al.  Fast opposite weight learning rules with application in breast cancer diagnosis , 2013, Comput. Biol. Medicine.

[12]  Rangaraj M. Rangayyan,et al.  Content-based Retrieval of Mammograms Using Visual Features Related to Breast Density Patterns , 2007, Journal of Digital Imaging.

[13]  Nebi Gedik,et al.  A new feature extraction method based on multi-resolution representations of mammograms , 2016, Appl. Soft Comput..

[14]  Matti Pietikäinen,et al.  Rotation-Invariant Image and Video Description With Local Binary Pattern Features , 2012, IEEE Transactions on Image Processing.

[15]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[16]  Ezzeddine Zagrouba,et al.  Multi-view score fusion for content-based mammogram retrieval , 2015, International Conference on Machine Vision.

[17]  Dimitris N. Metaxas,et al.  Detection of Mammographic Masses by Content-Based Image Retrieval , 2014, MLMI.

[18]  Yide Ma,et al.  An Efficient Approach for Automated Mass Segmentation and Classification in Mammograms , 2015, Journal of Digital Imaging.

[19]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[20]  Gwénolé Quellec,et al.  Wavelet optimization for content-based image retrieval in medical databases , 2010, Medical Image Anal..

[21]  E. Zagrouba,et al.  A Collaborative System for Pigmented Skin Lesions Malignancy Tracking , 2007, 2007 IEEE International Workshop on Imaging Systems and Techniques.

[22]  G. Witham,et al.  Information needs of the informal carers of women treated for breast cancer. , 2007, European journal of oncology nursing : the official journal of European Oncology Nursing Society.

[23]  David D. Lewis,et al.  Naive (Bayes) at Forty: The Independence Assumption in Information Retrieval , 1998, ECML.

[24]  S. Audithan,et al.  Wavelet and curvelet analysis for the classification of microcalcifiaction using mammogram images , 2014, Second International Conference on Current Trends In Engineering and Technology - ICCTET 2014.

[25]  Agma J. M. Traina,et al.  Using an image-extended relational database to support content-based image retrieval in a PACS , 2005, Comput. Methods Programs Biomed..