Combining Patient Metadata Extraction and Automatic Image Parsing for the Generation of an Anatomic Atlas

We present a system that integrates ontology-based metadata extraction from medical images with a state-of-the-art object recognition algorithm for 3D volume data sets generated by Computed Tomography scanners. Extracted metadata and automatically generated medical image annotations are stored as instances of OWL classes. This system is applied to a corpus of over 750 GB of clinical image data. A spatial database is used to store and retrieve 3D representations of the generated medical image annotations. Our integrated data representation allows us to easily analyze our corpus and to estimate the quality of image metadata. A rule-based system is used to check the plausibility of the output of the automatic object recognition technique against the Foundational Model of Anatomy ontology. All combined, these methods are used to determine an appropriate set of metadata and image features for the automatic generation of a spatial atlas of human anatomy.

[1]  Isabelle Bloch,et al.  Directional relative position between objects in image processing: a comparison between fuzzy approaches , 2003, Pattern Recognit..

[2]  Pinar Wennerberg,et al.  Extending the Foundational Model of Anatomy with Automatically Acquired Spatial Relations , 2009 .

[3]  James A. Hendler,et al.  The Semantic Web — ISWC 2002 , 2002, Lecture Notes in Computer Science.

[4]  Cristian Lorenz,et al.  Generation of Point-Based 3D Statistical Shape Models for Anatomical Objects , 2000, Comput. Vis. Image Underst..

[5]  Bruce I. Reiner,et al.  Addressing the Coming Radiology Crisis—The Society for Computer Applications in Radiology Transforming the Radiological Interpretation Process (TRIP™) Initiative , 2004, Journal of Digital Imaging.

[6]  James M. Keller,et al.  Quantitative analysis of properties and spatial relations of fuzzy image regions , 1993, IEEE Trans. Fuzzy Syst..

[7]  Isabelle Bloch,et al.  On fuzzy distances and their use in image processing under imprecision , 1999, Pattern Recognit..

[8]  Saikat Mukherjee,et al.  Semantic annotation of medical images , 2010, Medical Imaging.

[9]  Barry,et al.  Anatomy Ontologies for Bioinformatics: Principles and Practice , 2008 .

[10]  Ashish B. Shah,et al.  Common Object Request Broker Architecture (CORBA) , 2015 .

[11]  Cornelius Rosse,et al.  The Foundational Model of Anatomy Ontology , 2008, Anatomy Ontologies for Bioinformatics.

[12]  Michael Kohnen,et al.  Quality of DICOM header information for image categorization , 2002, SPIE Medical Imaging.

[13]  Manuel Möller,et al.  RadSem: Semantic Annotation and Retrieval for Medical Images , 2009, ESWC.

[14]  Frank van Harmelen,et al.  Sesame: A Generic Architecture for Storing and Querying RDF and RDF Schema , 2002, SEMWEB.

[15]  Lora Aroyo,et al.  The Semantic Web: Research and Applications , 2009, Lecture Notes in Computer Science.

[16]  Albert Burger,et al.  Anatomy Ontologies for Bioinformatics, Principles and Practice , 2010, Anatomy Ontologies for Bioinformatics.

[17]  Isabelle Bloch,et al.  Fuzzy spatial relationships for image processing and interpretation: a review , 2005, Image Vis. Comput..

[18]  Eros Comunello,et al.  Analyzing DICOM and non-DICOM Features in Content-Based Medical Image Retrieval: A Multi-Layer Approach , 2006, 19th IEEE Symposium on Computer-Based Medical Systems (CBMS'06).