A concept-based interactive biomedical image retrieval approach using visualness and spatial information

This paper presents a novel approach to biomedical image retrieval by mapping image regions to local concepts and represent images in a weighted entropy-based concept feature space. The term concept refers to perceptually distinguishable visual patches that are identified locally in image regions and can be mapped to a glossary of imaging terms. Further, the visual significance (e.g., visualness) of concepts is measured as Shannon entropy of pixel values in image patches and is used to refine the feature vector. Moreover, the system can assist user in interactively select a Region-Of-Interest (ROI) and search for similar image ROIs. Further, a spatial verification step is used as a post-processing step to improve retrieval results based on location information. The hypothesis that such approaches would improve biomedical image retrieval, is validated through experiments on a data set of 450 lung CT images extracted from journal articles from four different collections.

[1]  Bipin C. Desai,et al.  A Framework for Medical Image Retrieval Using Machine Learning and Statistical Similarity Matching Techniques With Relevance Feedback , 2007, IEEE Transactions on Information Technology in Biomedicine.

[2]  Carla E. Brodley,et al.  ASSERT: A Physician-in-the-Loop Content-Based Retrieval System for HRCT Image Databases , 1999, Comput. Vis. Image Underst..

[3]  Antoine Geissbühler,et al.  Integrating Content-Based Visual Access Methods into a Medical Case Database , 2003, MIE.

[4]  N. Müller,et al.  Fleischner Society: glossary of terms for thoracic imaging. , 2008, Radiology.

[5]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[6]  Michael Krauthammer,et al.  Yale Image Finder (YIF): a new search engine for retrieving biomedical images , 2008, Bioinform..

[7]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[8]  George R. Thoma,et al.  Annotation and retrieval of clinically relevant images , 2009, Int. J. Medical Informatics.

[9]  Antoine Geissbühler,et al.  A Review of Content{Based Image Retrieval Systems in Medical Applications { Clinical Bene(cid:12)ts and Future Directions , 2022 .

[10]  Henning Müller,et al.  Overview of the ImageCLEF 2012 Medical Image Retrieval and Classification Tasks , 2012, CLEF.

[11]  Mathias Lux,et al.  Lire: lucene image retrieval: an extensible java CBIR library , 2008, ACM Multimedia.

[12]  George R. Thoma,et al.  A medical image retrieval framework in correlation enhanced visual concept feature space , 2009, 2009 22nd IEEE International Symposium on Computer-Based Medical Systems.

[13]  L. Rodney Long,et al.  SPIRS: A Web-based image retrieval system for large biomedical databases , 2009, Int. J. Medical Informatics.

[14]  Chih-Jen Lin,et al.  Probability Estimates for Multi-class Classification by Pairwise Coupling , 2003, J. Mach. Learn. Res..

[15]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[16]  José Cáceres,et al.  Lymphangioleiomyomatosis: pulmonary and abdominal findings with pathologic correlation. , 2002, Radiographics : a review publication of the Radiological Society of North America, Inc.

[17]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[18]  Thomas M. Lehmanna,et al.  Header for SPIE use Content-Based Image Retrieval in Medical Applications: A Novel Multi-Step Approach , 2022 .

[19]  Lei Zhu,et al.  Using Keyblock Statistics to Model Image Retrieval , 2001, IEEE Pacific Rim Conference on Multimedia.

[20]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[21]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[22]  Preslav Nakov,et al.  BioText Search Engine: beyond abstract search , 2007, Bioinform..

[23]  Xin-Jing Wang,et al.  Towards Measruing the Visualness of a Concept ∗ , 2012 .