Pathology-centric medical image retrieval with hierarchical contextual spatial descriptor

Content-based image retrieval has been suggested as an aid to medical diagnosis. Techniques based on standard feature descriptors, however, might not represent optimally the pathological characteristics in medical images. In this paper, we propose a new approach for medical image retrieval based on pathology-centric feature extraction and representation; and patch-based local feature extraction and hierarchical contextual spatial descriptor are designed. The proposed method is evaluated on positron emission tomography - computed tomography (PET-CT) images from subjects with non-small cell lung cancer (NSCLC), showing promising performance improvements over the other benchmarked techniques.

[1]  George R. Thoma,et al.  A biomedical image retrieval framework based on classification-driven image filtering and similarity fusion , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[2]  Weidong Cai,et al.  Hierarchical spatial matching for medical image retrieval , 2011, MMAR '11.

[3]  David Dagan Feng,et al.  Discriminative Pathological Context Detection in Thoracic Images Based on Multi-level Inference , 2011, MICCAI.

[4]  Antoine Geissbühler,et al.  Building a reference multimedia database for interstitial lung diseases , 2012, Comput. Medical Imaging Graph..

[5]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[7]  Antoine Geissbühler,et al.  A Review of Content{Based Image Retrieval Systems in Medical Applications { Clinical Bene(cid:12)ts and Future Directions , 2022 .

[8]  Hayit Greenspan,et al.  X-ray Categorization and Retrieval on the Organ and Pathology Level, Using Patch-Based Visual Words , 2011, IEEE Transactions on Medical Imaging.

[9]  Yasuo Kuniyoshi,et al.  Improving Local Descriptors by Embedding Global and Local Spatial Information , 2010, ECCV.

[10]  David Dagan Feng,et al.  Thoracic image case retrieval with spatial and contextual information , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.