An image feature-based approach to automatically find images for application to clinical decision support

The illustrations in biomedical publications often provide useful information in aiding clinicians' decisions when full text searching is performed to find evidence in support of a clinical decision. In this research, image analysis and classification techniques are explored to automatically extract information for differentiating specific modalities to characterize illustrations in biomedical publications, which may assist in the evidence finding process. Global, histogram-based, and texture image illustration features were compared to basis function luminance histogram correlation features for modality-based discrimination over a set of 742 manually annotated images by modality (radiological, photo, etc.) selected from the 2004-2005 issues of the British Journal of Oral and Maxillofacial Surgery. Using a mean shifting supervised clustering technique, automatic modality-based discrimination results as high as 95.57% were obtained using the basis function features. These results compared favorably to other feature categories examined. The experimental results show that image-based features, particularly correlation-based features, can provide useful modality discrimination information.

[1]  José Alfredo Ferreira Costa,et al.  Content Based Image Retrieval using a Descriptors Hierarchy , 2007, 7th International Conference on Hybrid Intelligent Systems (HIS 2007).

[2]  B Braumann,et al.  Diagnosis and management of cervical teratomas. , 2004, The British journal of oral & maxillofacial surgery.

[3]  Andrew Coombes,et al.  The role of the maxillofacial surgeon in the initial 48 h following a terrorist attack. , 2005, The British journal of oral & maxillofacial surgery.

[4]  Aya Soffer.  Image categorization using texture features , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[5]  Mingsheng Liu,et al.  User Interest Model-based Image Retrieval Technique , 2007, 2007 IEEE International Conference on Automation and Logistics.

[6]  Yutaka Yamazaki,et al.  Migration of gutta-percha point from a root canal into the ethmoid sinus. , 2004, The British journal of oral & maxillofacial surgery.

[7]  Murad S. Taqqu,et al.  Semi-parametric estimation of the long-range dependence parameter : A survey , 2003 .

[8]  José Alfredo Ferreira Costa,et al.  The Semantic Clustering of Images and Its Relation with Low Level Color Features , 2008, 2008 IEEE International Conference on Semantic Computing.

[9]  George R. Thoma,et al.  Annotation and retrieval of clinically relevant images , 2009, Int. J. Medical Informatics.

[10]  W R Fright,et al.  Use of hand-held laser scanning in the assessment of facial swelling: a preliminary study. , 2004, The British journal of oral & maxillofacial surgery.

[11]  L. R. Long,et al.  Content-based Image Retrieval for Scientific Literature Access , 2009, Methods of Information in Medicine.

[12]  Yu Nenghai,et al.  A set of novel textural features based on 3D co-occurrence matrix for content-based image retrieval , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[13]  Arun K. Pujari,et al.  Texture element feature characterizations for CBIR , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[14]  Hichem Frigui,et al.  Fusion of multi-modal features for efficient content-based image retrieval , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[15]  Richard Bibb,et al.  The development of a collaborative medical modelling service: organisational and technical considerations. , 2004, The British journal of oral & maxillofacial surgery.

[16]  B. S. Manjunath,et al.  An efficient color representation for image retrieval , 2001, IEEE Trans. Image Process..

[17]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[18]  George R. Thoma,et al.  A medical image retrieval framework in correlation enhanced visual concept feature space , 2009, 2009 22nd IEEE International Symposium on Computer-Based Medical Systems.

[19]  S. Hain,et al.  Positron emission tomography in cancer of the head and neck. , 2005, The British journal of oral & maxillofacial surgery.

[20]  Giuseppe Argenziano,et al.  A basis function feature‐based approach for skin lesion discrimination in dermatology dermoscopy images , 2008, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[21]  S. Sergyan,et al.  Color histogram features based image classification in content-based image retrieval systems , 2008, 2008 6th International Symposium on Applied Machine Intelligence and Informatics.

[22]  P.S. Hiremath,et al.  Content Based Image Retrieval Using Color, Texture and Shape Features , 2007, 15th International Conference on Advanced Computing and Communications (ADCOM 2007).

[23]  Masahiro Umeda,et al.  En bloc resection of the primary tumour and cervical lymph nodes through the parapharyngeal space in patients with squamous cell carcinoma of the maxilla: a preliminary study. , 2005, The British journal of oral & maxillofacial surgery.

[24]  Hua Yuan,et al.  Texture image retrieval based on a Gaussian mixture model and similarity measure using a Kullback divergence , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[25]  Zhigang Liu,et al.  Content-based color image retrieval via lifting scheme , 2005, Proceedings Autonomous Decentralized Systems, 2005. ISADS 2005..

[26]  George R. Thoma,et al.  A classification-driven similarity matching framework for retrieval of biomedical images , 2010, MIR '10.

[27]  Sameer Antani,et al.  Automatically Finding Images for Clinical Decision Support , 2007 .

[28]  Haci Saglam,et al.  Comparison of stability of absorbable and titanium plate and screw fixation for sagittal split ramus osteotomy. , 2004, The British journal of oral & maxillofacial surgery.

[29]  J. Piper,et al.  On fully automatic feature measurement for banded chromosome classification. , 1989, Cytometry.

[30]  B Saka,et al.  The influence of pre- and intraoperative positioning of the condyle in the centre of the articular fossa on the position of the disc in orthognathic surgery. A magnetic resonance study. , 2004, The British journal of oral & maxillofacial surgery.

[31]  S. Sural,et al.  Characteristics of weighted feature vector in content-based image retrieval applications , 2004, International Conference on Intelligent Sensing and Information Processing, 2004. Proceedings of.

[32]  Murad S. Taqqu,et al.  Theory and applications of long-range dependence , 2003 .

[33]  E D Williams,et al.  Effects of repeated drill use on temperature of bone during preparation for osteosynthesis self-tapping screws. , 2005, The British journal of oral & maxillofacial surgery.

[34]  D. Lindberg,et al.  The Unified Medical Language System , 1993, Methods of Information in Medicine.

[35]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .