Discriminative cue integration for medical image annotation

Automatic annotation of medical images is an increasingly important tool for physicians in their daily activity. Hospitals nowadays produce an increasing amount of data. Manual annotation is very costly and prone to human mistakes. This paper proposes a multi-cue approach to automatic medical image annotation. We represent images using global and local features. These cues are then combined using three alternative approaches, all based on the support vector machine algorithm. We tested our methods on the IRMA database, and with two of the three approaches proposed here we participated in the 2007 ImageCLEFmed benchmark evaluation, in the medical image annotation track. These algorithms ranked first and fifth, respectively among all submission. Experiments using the third approach also confirm the power of cue integration for this task. 2008 Elsevier B.V. All rights reserved.

[1]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  Keiji Tanaka,et al.  Coding visual images of objects in the inferotemporal cortex of the macaque monkey. , 1991, Journal of neurophysiology.

[3]  Glenn Healey,et al.  Combining color and geometric information for the illumination invariant recognition of 3-D objects , 1995, Proceedings of IEEE International Conference on Computer Vision.

[4]  Jiri Matas,et al.  On representation and matching of multi-coloured objects , 1995, Proceedings of IEEE International Conference on Computer Vision.

[5]  Bartlett W. Mel.  SEEMORE: Combining Color, Shape, and Texture Histogramming in a Neurally Inspired Approach to Visual Object Recognition , 1997, Neural Computation.

[6]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[7]  J. T. Robinson,et al.  Progressive search and retrieval in large image archives , 1998, IBM J. Res. Dev..

[8]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[10]  Michael Kohnen,et al.  Quality of DICOM header information for image categorization , 2002, SPIE Medical Imaging.

[11]  Pietro Perona,et al.  Object class recognition by unsupervised scale-invariant learning , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[12]  Zhaohui Sun.  Adaptation for multiple cue integration , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[13]  Barbara Caputo,et al.  Recognition with local features: the kernel recipe , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[14]  Jitendra Malik,et al.  Spectral grouping using the Nystrom method , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Fischer,et al.  The IRMA Reference Database and Its Use for Content-Based Image Retrieval in Medical Applications , 2004 .

[16]  Terence Sim,et al.  Exploring Face Space , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[17]  Barbara Caputo,et al.  Cue integration through discriminative accumulation , 2004, CVPR 2004.

[18]  Tony Lindeberg,et al.  Object recognition using composed receptive field histograms of higher dimensionality , 2004, ICPR 2004.

[19]  Kuldip K. Paliwal,et al.  Identity verification using speech and face information , 2004, Digit. Signal Process..

[20]  Roland Siegwart,et al.  Incremental robot mapping with fingerprints of places , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Thomas Martin Deserno,et al.  Baseline Results for the ImageCLEF 2006 Medical Automatic Annotation Task , 2006, CLEF.

[22]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[23]  Hermann Ney,et al.  Sparse Patch-Histograms for Object Classification in Cluttered Images , 2006, DAGM-Symposium.

[24]  Frédéric Jurie,et al.  Sampling Strategies for Bag-of-Features Image Classification , 2006, ECCV.

[25]  Jing Liu,et al.  Medical Image Annotation and Retrieval Using Visual Features , 2006, CLEF.

[26]  Eugene Kim,et al.  Overview of the ImageCLEFmed 2006 Medical Retrieval and Annotation Tasks , 2006, CLEF.

[27]  Stéfan Jacques Darmoni,et al.  MedIC/CISMeF at ImageCLEF 2006: Image Annotation and Retrieval Tasks , 2006, CLEF.

[28]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[29]  Hans Burkhardt,et al.  Grayscale Radiograph Annotation Using Local Relational Features , 2006, CLEF.

[30]  Tobias Gass,et al.  Performing Image Classification with a Frequency-based Information Retrieval Schema for ImageCLEF 2006 , 2006, CLEF.

[31]  Alexandrina Rogozan,et al.  Medical Image Categorization using a Texture Based Symbolic Description , 2006, 2006 International Conference on Image Processing.

[32]  Andrew Zisserman,et al.  Representing shape with a spatial pyramid kernel , 2007, CIVR '07.

[33]  Barbara Caputo,et al.  Cue Integration for Medical Image Annotation , 2007, CLEF.

[34]  In-So Kweon,et al.  Visual Categorization Robust to Large Intra-Class Variations using Entropy-guided Codebook , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[35]  Thomas Martin Deserno,et al.  Automatic medical image annotation in ImageCLEF 2007: Overview, results, and discussion , 2008, Pattern Recognit. Lett..

[36]  Barbara Caputo,et al.  Object Category Detection Using Audio-Visual Cues , 2008, ICVS.