Information Fusion in Biomedical Image Analysis: Combination of Data vs. Combination of Interpretations

Information fusion has, in the form of multiple classifier systems, long been a successful tool in pattern recognition applications. It is also becoming increasingly popular in biomedical image analysis, for example in computer-aided diagnosis and in image segmentation. In this paper, we extend the principles of multiple classifier systems by considering information fusion of classifier inputs rather than on their outputs, as is usually done. We introduce the distinction between combination of data (i.e., classifier inputs) vs. combination of interpretations (i.e., classifier outputs). We illustrate the two levels of information fusion using four different biomedical image analysis applications that can be implemented using fusion of either data or interpretations: atlas-based image segmentation, "average image" tissue classification, multi-spectral classification, and deformation-based group morphometry.

[1]  Torsten Rohlfing,et al.  Multi-classifier framework for atlas-based image segmentation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[2]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[3]  M I Miller,et al.  Mathematical textbook of deformable neuroanatomies. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Torsten Rohlfing,et al.  Nonrigid image registration in shared-memory multiprocessor environments with application to brains, breasts, and bees , 2003, IEEE Transactions on Information Technology in Biomedicine.

[5]  Adolf Pfefferbaum,et al.  Corpus callosum, pons, and cortical white matter in alcoholic women. , 2002, Alcoholism, clinical and experimental research.

[6]  R. Menzel,et al.  Bee brains, B-splines and computational democracy: generating an average shape atlas , 2001, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA 2001).

[7]  Athina P. Petropulu,et al.  ROC analysis of ultrasound tissue characterization classifiers for breast cancer diagnosis , 2003, IEEE Transactions on Medical Imaging.

[8]  C. Studholme,et al.  An intensity consistent filtering approach to the analysis of deformation tensor derived maps of brain shape , 2003, NeuroImage.

[9]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[10]  Enrico Blanzieri,et al.  A multiple classifier system for early melanoma diagnosis , 2003, Artif. Intell. Medicine.

[11]  Mario Vento,et al.  Automatic classification of clustered microcalcifications by a multiple expert system , 2003, Pattern Recognit..

[12]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[13]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[14]  R. Menzel,et al.  Three‐dimensional average‐shape atlas of the honeybee brain and its applications , 2005, The Journal of comparative neurology.

[15]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[16]  Lawrence H. Staib,et al.  IEEE Workshop on Mathematical Methods in Biomedical Image Analysis , 2001 .

[17]  Alejandro F Frangi,et al.  Automatic construction of 3-D statistical deformation models of the brain using nonrigid registration , 2003, IEEE Transactions on Medical Imaging.

[18]  D. Louis Collins,et al.  Design and construction of a realistic digital brain phantom , 1998, IEEE Transactions on Medical Imaging.

[19]  Galina L. Rogova,et al.  Information fusion approach to microcalcification characterization , 2002, Inf. Fusion.

[20]  Norbert Schuff,et al.  Deformation tensor morphometry of semantic dementia with quantitative validation , 2004, NeuroImage.

[21]  D L Hill,et al.  Automated three-dimensional registration of magnetic resonance and positron emission tomography brain images by multiresolution optimization of voxel similarity measures. , 1997, Medical physics.

[22]  Carl-Fredrik Westin,et al.  White matter hemisphere asymmetries in healthy subjects and in schizophrenia: a diffusion tensor MRI study , 2004, NeuroImage.

[23]  Torsten Rohlfing,et al.  Evaluation of atlas selection strategies for atlas-based image segmentation with application to confocal microscopy images of bee brains , 2004, NeuroImage.

[24]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[25]  Jean Meunier,et al.  Average Brain Models: A Convergence Study , 2000, Comput. Vis. Image Underst..

[26]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Alan C. Evans,et al.  A Unified Statistical Approach to Deformation-Based Morphometry , 2001, NeuroImage.

[28]  J E Desmond,et al.  Thinning of the corpus callosum in older alcoholic men: a magnetic resonance imaging study. , 1996, Alcoholism, clinical and experimental research.