Three dimensional multi-scale visual words for texture-based cerebellum segmentation

Segmentation of the various parts of the brain is a challenging area in medical imaging and it is a prerequisite for many image analysis tasks useful for clinical research. Advances have been made in generating brain image templates that can be registered to automatically segment regions of interest in the human brain. However, these methods may fail with some subjects if there is a significant shape distortion or difference from the proposed models. This is also the case of newborns, where the developing brain strongly differs from adult magnetic resonance imaging (MRI) templates. In this article, a texture-based cerebellum segmentation method is described. The algorithm presented does not use any prior spatial knowledge to segment the MRI images. Instead, the system learns the texture features by means of a multi-scale filtering and visual words feature aggregation. Visual words are a commonly used technique in image retrieval. Instead of using visual features directly, the features of specific regions are modeled (clustered) into groups of discriminative features. This means that the final feature space can be reduced in size and also that the visual words in local regions are really discriminative for the given data set. The system is currently trained and tested with a dataset of 18 adult brain MRIs. An extension to the use with newborn brain images is being foreseen as this could highlight the advantages of the proposed technique. Results show that the use of texture features can be valuable for the task described and can lead to good results. The use of visual words can potentially improve robustness of existing shape-based techniques for cases with significant shape distortion or other differences from the models. As the visual words based techniques are not assuming any prior knowledge such techniques could be used for other types of segmentations as well using a large variety of basic visual features.

[1]  Peter L. Reichertz,et al.  Hospital information systems - Past, present, future , 2006, Int. J. Medical Informatics.

[2]  Yoshitomo Yaginuma,et al.  Classification of solid textures using 3D mask patterns , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[3]  Henning Müller,et al.  Using Multiscale Visual Words for Lung Texture Classification and Retrieval , 2011, MCBR-CDS.

[4]  Antoine Geissbühler,et al.  Case-based lung image categorization and retrieval for interstitial lung diseases: clinical workflows , 2011, International Journal of Computer Assisted Radiology and Surgery.

[5]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  A. Dale,et al.  Whole Brain Segmentation Automated Labeling of Neuroanatomical Structures in the Human Brain , 2002, Neuron.

[7]  Hayit Greenspan,et al.  X-ray Categorization and Retrieval on the Organ and Pathology Level, Using Patch-Based Visual Words , 2011, IEEE Transactions on Medical Imaging.

[8]  C. Fennema-Notestine,et al.  Effects of age on tissues and regions of the cerebrum and cerebellum , 2001, Neurobiology of Aging.

[9]  Constantino Carlos Reyes-Aldasoro,et al.  Volumetric Texture Segmentation by Discriminant Feature Selection and Multiresolution Classification , 2007, IEEE Transactions on Medical Imaging.

[10]  Michael Unser,et al.  Texture classification and segmentation using wavelet frames , 1995, IEEE Trans. Image Process..

[11]  Atam P. Dhawan,et al.  Analysis of mammographic microcalcifications using gray-level image structure features , 1996, IEEE Trans. Medical Imaging.

[12]  Antoine Geissbühler,et al.  3D Case-Based Retrieval for Interstitial Lung Diseases , 2009, MCBR-CDS.

[13]  Stefan Klein,et al.  Cerebellum segmentation in MRI using atlas registration and local multi-scale image descriptors , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[14]  B. Puri,et al.  Cerebellum segmentation employing texture properties and knowledge based image processing: applied to normal adult controls and patients. , 2002, Magnetic resonance imaging.

[15]  Naoki Kodama,et al.  Application of Texture Analysis to Differentiation of Dementia with Lewy Bodies from Alzheimer’s Disease on Magnetic Resonance Images , 2007 .

[16]  Antoine Geissbühler,et al.  A Review of Content{Based Image Retrieval Systems in Medical Applications { Clinical Bene(cid:12)ts and Future Directions , 2022 .

[17]  Jeffrey I Berman,et al.  Cerebellar Development in the Preterm Neonate: Effect of Supratentorial Brain Injury , 2009, Pediatric Research.

[18]  Koenraad Van Leemput,et al.  Automated model-based tissue classification of MR images of the brain , 1999, IEEE Transactions on Medical Imaging.

[19]  Usha Sinha,et al.  A Review of Medical Imaging Informatics , 2002, Annals of the New York Academy of Sciences.

[20]  James S. Duncan,et al.  Synthesis of Research: Medical Image Databases: A Content-based Retrieval Approach , 1997, J. Am. Medical Informatics Assoc..

[21]  Ari Visa,et al.  An adaptive texture and shape based defect classification , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[22]  Gwénolé Quellec,et al.  Case Retrieval in Medical Databases by Fusing Heterogeneous Information , 2015, IEEE Transactions on Medical Imaging.

[23]  Laura Gui,et al.  Automatic segmentation of newborn brain MRI using mathematical morphology , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[24]  Reinhold Haux,et al.  Health information systems - past, present, future , 2006, Int. J. Medical Informatics.

[25]  Henning Müller,et al.  Fusion Techniques for Combining Textual and Visual Information Retrieval , 2010, ImageCLEF.