Semi-automatic Semantic Tagging of 3D Images from Pancreas Cells

Detailed, consistent semantic annotation of large collections of multimedia data is difficult and time-consuming. In domains such as eScience, digital curation and industrial monitoring, fine-grained high-quality labeling of regions enables advanced semantic querying, analysis and aggregation and supports collaborative research. Manual annotation is inefficient and too subjective to be a viable solution. Automatic solutions are often highly domain or application specific, require large volumes of annotated training corpi and, if using a 'black box' approach, add little to the overall scientific knowledge. This article evaluates the use of simple artificial neural networks to semantically annotate micrographs and discusses the generic process chain necessary for semi-automatic semantic annotation of images.

[1]  Steffen Staab,et al.  M-OntoMat-Annotizer: Linking Ontologies with Multimedia Low-Level Features for Automatic Image Annotation , 2006 .

[2]  A. T. Schreiber,et al.  Semantic Annotation of Image Collections , 2003 .

[3]  Chrisa Tsinaraki,et al.  Ontology-Based Semantic Indexing for MPEG-7 and TV-Anytime Audiovisual Content , 2005, Multimedia Tools and Applications.

[4]  Petra Perner,et al.  Data Mining on Multimedia Data , 2002, Lecture Notes in Computer Science.

[5]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[6]  Petra Perner.  Case-Based Reasoning on Images and Signals , 2008, Studies in Computational Intelligence.

[7]  Jane Hunter,et al.  Evaluating the application of semantic inferencing rules to image annotation , 2005, K-CAP '05.

[8]  Milind R. Naphade,et al.  Detecting semantic concepts using context and audiovisual features , 2001, Proceedings IEEE Workshop on Detection and Recognition of Events in Video.

[9]  D. Mastronarde,et al.  Organellar relationships in the Golgi region of the pancreatic beta cell line, HIT-T15, visualized by high resolution electron tomography , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Marcel Worring,et al.  Building a visual ontology for video retrieval , 2005, MULTIMEDIA '05.

[11]  Jane Hunter,et al.  A framework to enable the semantic inferencing and querying of multimedia content , 2005, Int. J. Web Eng. Technol..

[12]  John R. Smith,et al.  Semantic Indexing of Multimedia Content Using Visual, Audio, and Text Cues , 2003, EURASIP J. Adv. Signal Process..

[13]  Roberto García,et al.  Semantic Integration and Retrieval of Multimedia Metadata , 2005, SemAnnot@ISWC.

[14]  Jane Hunter,et al.  Rules-By-Example - A Novel Approach to Semantic Indexing and Querying of Images , 2004, SEMWEB.

[15]  C. Fellbaum.  An Electronic Lexical Database , 1998 .

[16]  D. Vanel.  The American College of Radiology (ACR) Breast Imaging and Reporting Data System (BI-RADS): a step towards a universal radiological language? , 2007, European journal of radiology.

[17]  Milind R. Naphade,et al.  Learning the semantics of multimedia queries and concepts from a small number of examples , 2005, MULTIMEDIA '05.

[18]  Jane Hunter,et al.  Adding Multimedia to the SemanticWeb: Building and Applying an MPEG-7 Ontology , 2005, Multimedia Content and the Semantic Web.

[19]  Steffen Schulze-Kremer,et al.  The Ontology of the Gene Ontology , 2003, AMIA.

[20]  Heinrich Niemann,et al.  Brain volumes characterisation using hierarchical neural networks , 2003, Artif. Intell. Medicine.

[21]  Steffen Staab,et al.  Semantic Annotation of Images and Videos for Multimedia Analysis , 2005, ESWC.

[22]  K. Ramchandran,et al.  A factor graph framework for semantic indexing and retrieval in video , 2000, 2000 Proceedings Workshop on Content-based Access of Image and Video Libraries.

[23]  William I. Grosky,et al.  Negotiating the semantic gap: from feature maps to semantic landscapes , 2002, Pattern Recognit..

[24]  Shih-Fu Chang,et al.  Image classification using multimedia knowledge networks , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[25]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[26]  Shih-Fu Chang,et al.  Semantic visual templates: linking visual features to semantics , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[27]  L. Liberman,et al.  Breast imaging reporting and data system (BI-RADS). , 2002, Radiologic clinics of North America.

[28]  C E Lipscomb,et al.  Medical Subject Headings (MeSH). , 2000, Bulletin of the Medical Library Association.

[29]  Jennifer Williams,et al.  Bringing Ontology to the Gene Ontology , 2003, Comparative and functional genomics.

[30]  R. Finke,et al.  Principles of mental imagery , 1989 .

[31]  Sara Colantonio,et al.  Automatic Fuzzy-Neural based Segmentation of Microscopic Cell Images , 2006, Industrial Conference on Data Mining - Workshops.

[32]  Petra Perner,et al.  Prototype-based classification , 2008, Applied Intelligence.

[33]  Petra Perner,et al.  A comparison between neural networks and decision trees based on data from industrial radiographic testing , 2001, Pattern Recognit. Lett..