Immediate ROI Search for 3-D Medical Images

The objective of this work is a scalable, real-time, visual search engine for 3-D medical images, where a user is able to select a query Region Of Interest (ROI) and automatically detect the corresponding regions within all returned images. We make three contributions: (i) we show that with appropriate off-line processing, images can be retrieved and ROIs registered in real time; (ii) we propose and evaluate a number of scalable exemplar-based image registration schemes; (iii) we propose a discriminative method for learning to rank the returned images based on the content of the ROI. The retrieval system is demonstrated on MRI data from the ADNI dataset, and it is shown that the learnt ranking function outperforms the baseline. © 2013 Springer-Verlag.

[1]  Sébastien Ourselin,et al.  Fast free-form deformation using graphics processing units , 2010, Comput. Methods Programs Biomed..

[2]  Kyomin Jung,et al.  Energy Minimization under Constraints on Label Counts , 2010, ECCV.

[3]  Sébastien Ourselin,et al.  Multi-STEPS: Multi-label similarity and truth estimation for propagated segmentations , 2012, 2012 IEEE Workshop on Mathematical Methods in Biomedical Image Analysis.

[4]  Andrew Zisserman,et al.  Texture classification: are filter banks necessary? , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[5]  Marc Modat,et al.  LoAd: A locally adaptive cortical segmentation algorithm , 2011, NeuroImage.

[6]  C. Jack,et al.  Comparison of different MRI brain atrophy rate measures with clinical disease progression in AD , 2004, Neurology.

[7]  Antoine Geissbühler,et al.  A Review of Content{Based Image Retrieval Systems in Medical Applications { Clinical Bene(cid:12)ts and Future Directions , 2022 .

[8]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[9]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[10]  C. Jack,et al.  Ways toward an early diagnosis in Alzheimer’s disease: The Alzheimer’s Disease Neuroimaging Initiative (ADNI) , 2005, Alzheimer's & Dementia.

[11]  Hayit Greenspan,et al.  X-ray Categorization and Retrieval on the Organ and Pathology Level, Using Patch-Based Visual Words , 2011, IEEE Transactions on Medical Imaging.

[12]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Franz Kainberger,et al.  Texture Bags: Anomaly Retrieval in Medical Images Based on Local 3D-Texture Similarity , 2011, MCBR-CDS.

[14]  Antoine Geissbühler,et al.  Erratum to "A review of content-based image retrieval systems in medical applications - Clinical benefits and future directions" [I. J. Medical Informatics 73 (1) (2004) 1-23] , 2009, Int. J. Medical Informatics.

[15]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[16]  Antonio Criminisi,et al.  Immediate Structured Visual Search for Medical Images , 2011, MICCAI.

[17]  H. Greenspan,et al.  Automated retrieval of CT images of liver lesions on the basis of image similarity: method and preliminary results. , 2010, Radiology.

[18]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.