Toward cognitive pipelines of medical assistance algorithms

PurposeAssistance algorithms for medical tasks have great potential to support physicians with their daily work. However, medicine is also one of the most demanding domains for computer-based support systems, since medical assistance tasks are complex and the practical experience of the physician is crucial. Recent developments in the area of cognitive computing appear to be well suited to tackle medicine as an application domain.MethodsWe propose a system based on the idea of cognitive computing and consisting of auto-configurable medical assistance algorithms and their self-adapting combination. The system enables automatic execution of new algorithms, given they are made available as Medical Cognitive Apps and are registered in a central semantic repository. Learning components can be added to the system to optimize the results in the cases when numerous Medical Cognitive Apps are available for the same task. Our prototypical implementation is applied to the areas of surgical phase recognition based on sensor data and image progressing for tumor progression mappings.ResultsOur results suggest that such assistance algorithms can be automatically configured in execution pipelines, candidate results can be automatically scored and combined, and the system can learn from experience. Furthermore, our evaluation shows that the Medical Cognitive Apps are providing the correct results as they did for local execution and run in a reasonable amount of time.ConclusionThe proposed solution is applicable to a variety of medical use cases and effectively supports the automated and self-adaptive configuration of cognitive pipelines based on medical interpretation algorithms.

[1]  Gero Strauß,et al.  Research Paper: Validation of Knowledge Acquisition for Surgical Process Models , 2009, J. Am. Medical Informatics Assoc..

[2]  David A. Ferrucci.  Build watson: An overview of DeepQA for the Jeopardy! Challenge , 2010, 2010 19th International Conference on Parallel Architectures and Compilation Techniques (PACT).

[3]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[4]  Deepak S. Turaga,et al.  Big Data Exploration Via Automated Orchestration of Analytic Workflows , 2013, ICAC.

[5]  Kevin Leyton-Brown,et al.  Auto-WEKA: combined selection and hyperparameter optimization of classification algorithms , 2012, KDD.

[6]  Kevin Cleary,et al.  OR 2020: the operating room of the future. , 2004, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[7]  Michael KranzfelderChristoph.  Toward increased autonomy in the surgical OR: needs, requests, and expectations , 2012 .

[8]  Stefanie Speidel,et al.  Automatic classification of minimally invasive instruments based on endoscopic image sequences , 2009, Medical Imaging.

[9]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[10]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[11]  Mark D. Wilkinson,et al.  OWL-DL Domain-Models as Abstract Workflows , 2012, ISoLA.

[12]  Melanie Hilario,et al.  Using Meta-mining to Support Data Mining Workflow Planning and Optimization , 2014, J. Artif. Intell. Res..

[13]  Ricardo Vilalta,et al.  Metalearning - Applications to Data Mining , 2008, Cognitive Technologies.

[14]  Sebastian Speiser,et al.  Integrating Linked Data and Services with Linked Data Services , 2011, ESWC.

[15]  Steffen Stadtmüller,et al.  Data-Fu: a language and an interpreter for interaction with read/write linked data , 2013, WWW.

[16]  Rüdiger Dillmann,et al.  Knowledge-Driven Formalization of Laparoscopic Surgeries for Rule-Based Intraoperative Context-Aware Assistance , 2014, IPCAI.

[17]  Klaus H. Maier-Hein,et al.  Using Linked Data and Web APIs for Automating the Pre-processing of Medical Images , 2014, COLD.

[18]  Gero Strauß,et al.  Acquisition of Process Descriptions from Surgical Interventions , 2006, DEXA.

[19]  Lola Butcher.  Case Study: How Health IT is Changing the Practice of Oncology—Using Data in New Ways , 2012 .

[20]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[21]  Lars Kotthoff,et al.  Algorithm Selection for Combinatorial Search Problems: A Survey , 2012, AI Mag..

[22]  Markus Krötzsch,et al.  Semantic MediaWiki , 2006, International Semantic Web Conference.

[23]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[24]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[25]  Joseph P. Joyce,et al.  A History and Overview of the Safety Parameter Display System Concept , 1983, IEEE Transactions on Nuclear Science.

[26]  Edward A. Lee,et al.  CONCURRENCY AND COMPUTATION: PRACTICE AND EXPERIENCE Concurrency Computat.: Pract. Exper. 2000; 00:1–7 Prepared using cpeauth.cls [Version: 2002/09/19 v2.02] Taverna: Lessons in creating , 2022 .

[27]  Yolanda Gil,et al.  A semantic framework for automatic generation of computational workflows using distributed data and component catalogues , 2011, J. Exp. Theor. Artif. Intell..

[28]  Pierre Jannin,et al.  Automatic knowledge-based recognition of low-level tasks in ophthalmological procedures , 2012, International Journal of Computer Assisted Radiology and Surgery.

[29]  Chabane Djeraba,et al.  Applications to Databases and Data Mining , 2014 .

[30]  Horst Samulowitz,et al.  Cognitive Automation of Data Science , 2014 .