Extended Query Refinement for Medical Image Retrieval

The impact of image pattern recognition on accessing large databases of medical images has recently been explored, and content-based image retrieval (CBIR) in medical applications (IRMA) is researched. At the present, however, the impact of image retrieval on diagnosis is limited, and practical applications are scarce. One reason is the lack of suitable mechanisms for query refinement, in particular, the ability to (1) restore previous session states, (2) combine individual queries by Boolean operators, and (3) provide continuous-valued query refinement. This paper presents a powerful user interface for CBIR that provides all three mechanisms for extended query refinement. The various mechanisms of man–machine interaction during a retrieval session are grouped into four classes: (1) output modules, (2) parameter modules, (3) transaction modules, and (4) process modules, all of which are controlled by a detailed query logging. The query logging is linked to a relational database. Nested loops for interaction provide a maximum of flexibility within a minimum of complexity, as the entire data flow is still controlled within a single Web page. Our approach is implemented to support various modalities, orientations, and body regions using global features that model gray scale, texture, structure, and global shape characteristics. The resulting extended query refinement has a significant impact for medical CBIR applications.

[1]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Eugene Kim,et al.  Overview of the ImageCLEFmed 2006 Medical Retrieval and Medical Annotation Tasks , 2006, CLEF.

[3]  Ilaria Bartolini,et al.  FeedbackBypass: A New Approach to Interactive Similarity Query Processing , 2001, VLDB.

[4]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[5]  Wenyin Liu,et al.  New query refinement and semantics integrated image retrieval system with semiautomatic annotation scheme , 2001, J. Electronic Imaging.

[6]  Antoine Geissbühler,et al.  Erratum to "A review of content-based image retrieval systems in medical applications - Clinical benefits and future directions" [I. J. Medical Informatics 73 (1) (2004) 1-23] , 2009, Int. J. Medical Informatics.

[7]  T M Lehmann,et al.  Content-based Image Retrieval in Medical Applications , 2004, Methods of Information in Medicine.

[8]  Antoine Geissbühler,et al.  A Review of Content{Based Image Retrieval Systems in Medical Applications { Clinical Bene(cid:12)ts and Future Directions , 2022 .

[9]  Thierry Pun,et al.  Strategies for positive and negative relevance feedback in image retrieval , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[10]  Hermann Ney,et al.  Extended query refinement for content-based access to large medical-image databases , 2004, SPIE Medical Imaging.

[11]  F. Crestani,et al.  Design of a graphical user interface for focussed retrieval of structured documents , 2001, Proceedings Eighth Symposium on String Processing and Information Retrieval.

[12]  Clement T. Yu,et al.  A tutorial on information retrieval: basic terms and concepts , 2006, Journal of biomedical discovery and collaboration.

[13]  James S. Duncan,et al.  Synthesis of Research: Medical Image Databases: A Content-based Retrieval Approach , 1997, J. Am. Medical Informatics Assoc..

[14]  Heidrun Schumann,et al.  A History Mechanism for Visual Data Mining , 2004, IEEE Symposium on Information Visualization.

[15]  Thomas Martin Deserno,et al.  A Generic Concept for the Implementation of Medical Image Retrieval Systems , 2005, MIE.

[16]  Eugene Kim,et al.  Overview of the ImageCLEFmed 2006 Medical Retrieval and Annotation Tasks , 2006, CLEF.

[17]  Erkki Oja,et al.  Self-Organising Maps as a Relevance Feedback Technique in Content-Based Image Retrieval , 2001, Pattern Analysis & Applications.

[18]  Fabio Crestani,et al.  A Graphical User Interface for Structured Document Retrieval , 2002, ECIR.

[19]  Chahab Nastar,et al.  Efficient query refinement for image retrieval , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[20]  John C. Dalton,et al.  Active browsing using similarity pyramids , 1998, Electronic Imaging.

[21]  Ophir Frieder,et al.  SENTINEL: A Multiple Engine Information Retrieval and Visualization System , 1999, J. Am. Soc. Inf. Sci..

[22]  Wei-Ying Ma,et al.  Learning a semantic space from user's relevance feedback for image retrieval , 2003, IEEE Trans. Circuits Syst. Video Technol..

[23]  Hermann Ney,et al.  The CLEF 2005 Automatic Medical Image Annotation Task , 2006, International Journal of Computer Vision.

[24]  Eugenio Di Sciascio,et al.  Feature integration and relevance feedback analysis in image similarity evaluation , 1998, J. Electronic Imaging.

[25]  Thomas Berlage,et al.  A selective undo mechanism for graphical user interfaces based on command objects , 1994, TCHI.

[26]  Thomas Sikora,et al.  Hierarchical image database browsing environment with embedded relevance feedback , 2002, Proceedings. International Conference on Image Processing.

[27]  Hermann Ney,et al.  Automatic categorization of medical images for content-based retrieval and data mining. , 2005, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.