Towards semantic-driven high-content image analysis: An operational instantiation for mitosis detection in digital histopathology

This study concerns a novel symbolic cognitive vision framework emerged from the Cognitive Microscopy (MICO(1)) initiative. MICO aims at supporting the evolution towards digital pathology, by studying cognitive clinical-compliant protocols involving routine virtual microscopy. We instantiate this paradigm in the case of mitotic count as a component of breast cancer grading in histopathology. The key concept of our approach is the role of the semantics as driver of the whole slide image analysis protocol. All the decisions being taken into a semantic and formal world, MICO represents a knowledge-driven platform for digital histopathology. Therefore, the core of this initiative is the knowledge representation and the reasoning. Pathologists' knowledge and strategies are used to efficiently guide image analysis algorithms. In this sense, hard-coded knowledge, semantic and usability gaps are to be reduced by a leading, active role of reasoning and of semantic approaches. Integrating ontologies and reasoning in confluence with modular imaging algorithms, allows the emergence of new clinical-compliant protocols for digital pathology. This represents a promising way to solve decision reproducibility and traceability issues in digital histopathology, while increasing the flexibility of the platform and pathologists' acceptance, the one always having the legal responsibility in the diagnosis process. The proposed protocols open the way to increasingly reliable cancer assessment (i.e. multiple slides per sample analysis), quantifiable and traceable second opinion for cancer grading, and modern capabilities for cancer research support in histopathology (i.e. content and context-based indexing and retrieval). Last, but not least, the generic approach introduced here is applicable for number of additional challenges, related to molecular imaging and, in general, to high-content image exploration.

[1]  Frank van Harmelen,et al.  A semantic web primer , 2004 .

[2]  Peter Szolovits,et al.  What Is a Knowledge Representation? , 1993, AI Mag..

[3]  Brian C. Lovell,et al.  Unsupervised cell nucleus segmentation with active contours , 1998, Signal Process..

[4]  Catherine Genestie,et al.  Un explorateur visuel cognitif (MIcroscope COgnitif - MICO) pour l'histopathologie. Application au diagnostic et à la graduation du cancer du sein. , 2011 .

[5]  Tim Berners-Lee,et al.  Publishing on the semantic web , 2001, Nature.

[6]  Funda Meric-Bernstam,et al.  High risk of recurrence for patients with breast cancer who have human epidermal growth factor receptor 2-positive, node-negative tumors 1 cm or smaller. , 2009, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[7]  L. Stein,et al.  OWL Web Ontology Language - Reference , 2004 .

[8]  Dieter Fensel,et al.  Knowledge Engineering: Principles and Methods , 1998, Data Knowl. Eng..

[9]  C. M. Sperberg-McQueen,et al.  Extensible Markup Language (XML) , 1997, World Wide Web J..

[10]  Adina Eunice Tutac [Formal representation and reasoning for microscopic medical image-based prognosis] : [application to breast cancer grading]. , 2010 .

[11]  Humayun Irshad,et al.  Automated Mitosis Detection in Color and Multi-spectral High-Content Images in Histopathology: Application to Breast Cancer Grading in Digital Pathology , 2014 .

[12]  James A. Hendler,et al.  Scientific publishing on the 'semantic web' , 2001 .

[13]  David Vernon,et al.  Cognitive Vision: the Case for Embodied Perception , 2005 .

[14]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[15]  Steffen Staab,et al.  Situation and Perspective of Knowledge Engineering , 2000 .

[16]  Tim Berners-Lee,et al.  Linked Data - The Story So Far , 2009, Int. J. Semantic Web Inf. Syst..

[17]  I. Ellis,et al.  Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up. , 2002, Histopathology.

[18]  I. Ellis,et al.  Pathological prognostic factors in breast cancer. , 1999, Critical reviews in oncology/hematology.

[19]  Lalana Kagal,et al.  N 3 Logic : A Logical Framework For the World Wide Web , 2007 .

[20]  H. Irshad,et al.  Methods for Nuclei Detection, Segmentation, and Classification in Digital Histopathology: A Review—Current Status and Future Potential , 2014, IEEE Reviews in Biomedical Engineering.

[21]  James A. Hendler,et al.  N3Logic: A logical framework for the World Wide Web , 2007, Theory and Practice of Logic Programming.

[22]  [Mammary pathology]. , 1991, Zentralblatt fur Pathologie.