Temporal abstraction and temporal Bayesian networks in clinical domains: A survey

OBJECTIVES Temporal abstraction (TA) of clinical data aims to abstract and interpret clinical data into meaningful higher-level interval concepts. Abstracted concepts are used for diagnostic, prediction and therapy planning purposes. On the other hand, temporal Bayesian networks (TBNs) are temporal extensions of the known probabilistic graphical models, Bayesian networks. TBNs can represent temporal relationships between events and their state changes, or the evolution of a process, through time. This paper offers a survey on techniques/methods from these two areas that were used independently in many clinical domains (e.g. diabetes, hepatitis, cancer) for various clinical tasks (e.g. diagnosis, prognosis). A main objective of this survey, in addition to presenting the key aspects of TA and TBNs, is to point out important benefits from a potential integration of TA and TBNs in medical domains and tasks. The motivation for integrating these two areas is their complementary function: TA provides clinicians with high level views of data while TBNs serve as a knowledge representation and reasoning tool under uncertainty, which is inherent in all clinical tasks. METHODS Key publications from these two areas of relevance to clinical systems, mainly circumscribed to the latest two decades, are reviewed and classified. TA techniques are compared on the basis of: (a) knowledge acquisition and representation for deriving TA concepts and (b) methodology for deriving basic and complex temporal abstractions. TBNs are compared on the basis of: (a) representation of time, (b) knowledge representation and acquisition, (c) inference methods and the computational demands of the network, and (d) their applications in medicine. RESULTS The survey performs an extensive comparative analysis to illustrate the separate merits and limitations of various TA and TBN techniques used in clinical systems with the purpose of anticipating potential gains through an integration of the two techniques, thus leading to a unified methodology for clinical systems. The surveyed contributions are evaluated using frameworks of respective key features. In addition, for the evaluation of TBN methods, a unifying clinical domain (diabetes) is used. CONCLUSION The main conclusion transpiring from this review is that techniques/methods from these two areas, that so far are being largely used independently of each other in clinical domains, could be effectively integrated in the context of medical decision-support systems. The anticipated key benefits of the perceived integration are: (a) during problem solving, the reasoning can be directed at different levels of temporal and/or conceptual abstractions since the nodes of the TBNs can be complex entities, temporally and structurally and (b) during model building, knowledge generated in the form of basic and/or complex abstractions, can be deployed in a TBN.

[1]  Drew McDermott,et al.  A Temporal Logic for Reasoning About Processes and Plans , 1982, Cogn. Sci..

[2]  Eric Horvitz,et al.  Dynamic Network Models for Forecasting , 1992, UAI.

[3]  David J. Spiegelhalter,et al.  Bayesian networks for patient monitoring , 1992, Artif. Intell. Medicine.

[4]  Chin-Hui Lee,et al.  Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains , 1994, IEEE Trans. Speech Audio Process..

[5]  Tu Bao Ho,et al.  Exploiting Temporal Relations in Mining Hepatitis Data , 2007, New Generation Computing.

[6]  Ross D. Shachter Probabilistic Inference and Influence Diagrams , 1988, Oper. Res..

[7]  A. H. Murphy,et al.  Hailfinder: A Bayesian system for forecasting severe weather , 1996 .

[8]  Giuseppe De Nicolao,et al.  Bayesian analysis of blood glucose time series from diabetes home monitoring , 2000, IEEE Transactions on Biomedical Engineering.

[9]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[10]  Elpida T. Keravnou,et al.  A Multidimensional and Multigranular Model of Time for Medical Knowledge-Based Systems , 1999, Journal of Intelligent Information Systems.

[11]  Nevin L. Zhang,et al.  A simple approach to Bayesian network computations , 1994 .

[12]  Geoffrey Zweig,et al.  Probabilistic modeling with Bayesian networks for automatic speech recognition , 1998, ICSLP.

[13]  Yuval Shahar,et al.  A Scalable Architecture for Incremental Specification and Maintenance of Procedural and Declarative Clinical Decision-Support Knowledge , 2010, The open medical informatics journal.

[14]  Terry Caelli,et al.  Building Detection Using Bayesian Networks , 2000, Int. J. Pattern Recognit. Artif. Intell..

[15]  Niels Peek,et al.  Explicit temporal models for decision-theoretic planning of clinical management , 1999, Artif. Intell. Medicine.

[16]  Evert de Jonge,et al.  Dichotomization of ICU Length of Stay Based on Model Calibration , 2005, AIME.

[17]  Dmitriy Fradkin,et al.  Robust Mining of Time Intervals with Semi-interval Partial Order Patterns , 2010, SDM.

[18]  Xiao Hu,et al.  Bayesian tracking of intracranial pressure signal morphology , 2012, Artif. Intell. Medicine.

[19]  Juan Carlos Augusto,et al.  Temporal reasoning for decision support in medicine , 2005, Artif. Intell. Medicine.

[20]  Eugene Santos,et al.  Probabilistic temporal networks: A unified framework for reasoning with time and uncertainty , 1999, Int. J. Approx. Reason..

[21]  Richard E. Neapolitan,et al.  Learning Bayesian networks , 2007, KDD '07.

[22]  Marek J Druzdzel,et al.  The Pittsburgh Cervical Cancer Screening Model: a risk assessment tool. , 2010, Archives of pathology & laboratory medicine.

[23]  Lashon B. Booker,et al.  Probabilistic reasoning about ship images , 1986, UAI.

[24]  Robert P. Goldman,et al.  A Semantics for Probabilistic Quantifier-Free First-Order Languages, with Particular Application to Story Understanding , 1989, IJCAI.

[25]  Steen Andreassen,et al.  The TREAT project: decision support and prediction using causal probabilistic networks. , 2007, International journal of antimicrobial agents.

[26]  Yongtae Park,et al.  Large engineering project risk management using a Bayesian belief network , 2009, Expert Syst. Appl..

[27]  Yoav Shoham,et al.  Temporal Logics in AI: Semantical and Ontological Considerations , 1987, Artif. Intell..

[28]  Carolyn McGregor,et al.  Temporal abstraction in intelligent clinical data analysis: A survey , 2007, Artif. Intell. Medicine.

[29]  T. Charitos,et al.  Reasoning with dynamic networks in practice , 2007 .

[30]  Marek J. Sergot,et al.  A logic-based calculus of events , 1989, New Generation Computing.

[31]  David J. Hand,et al.  Statistics and computing: the genesis of data science , 2015, Statistics and Computing.

[32]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[33]  Fabian Mörchen,et al.  Algorithms for time series knowledge mining , 2006, KDD '06.

[34]  Eamonn J. Keogh,et al.  Segmenting Time Series: A Survey and Novel Approach , 2002 .

[35]  D E Heckerman,et al.  Toward Normative Expert Systems: Part II Probability-Based Representations for Efficient Knowledge Acquisition and Inference , 1992, Methods of Information in Medicine.

[36]  Gregory M. Provan,et al.  Tradeoffs in Constructing and Evaluating Temporal Influence Diagrams , 1993, UAI.

[37]  L. Fahrmeir,et al.  A Bayesian Semiparametric Latent Variable Model for Mixed Responses , 2007 .

[38]  R. Bharat Rao,et al.  Continuous-Time Bayesian Modeling of Clinical Data , 2004, SDM.

[39]  U. M. Feyyad Data mining and knowledge discovery: making sense out of data , 1996 .

[40]  Evert de Jonge,et al.  Using hierarchical dynamic Bayesian networks to investigate dynamics of organ failure in patients in the Intensive Care Unit , 2010, J. Biomed. Informatics.

[41]  G F Cooper,et al.  A new formalism for temporal modeling in medical decision-support systems. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[42]  Eric Horvitz,et al.  The Lumière Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users , 1998, UAI.

[43]  Max Henrion,et al.  Propagating uncertainty in bayesian networks by probabilistic logic sampling , 1986, UAI.

[44]  Kevin P. Murphy,et al.  Learning the Structure of Dynamic Probabilistic Networks , 1998, UAI.

[45]  S W Tu,et al.  PROTEGE-II: computer support for development of intelligent systems from libraries of components. , 1995, Medinfo. MEDINFO.

[46]  Bruce G. Buchanan,et al.  The MYCIN Experiments of the Stanford Heuristic Programming Project , 1985 .

[47]  Lawrence M. Fagan,et al.  TQuery: a context-sensitive temporal query language. , 1991, Computers and biomedical research, an international journal.

[48]  Abraham Kandel,et al.  Data Mining in Time Series Database , 2004 .

[49]  M. Gerstein,et al.  A Bayesian Networks Approach for Predicting Protein-Protein Interactions from Genomic Data , 2003, Science.

[50]  Jim Hunter,et al.  Deriving Trends in Historical and Real-Time Continuously Sampled Medical Data , 1999, Journal of Intelligent Information Systems.

[51]  Yuval Shahar,et al.  Dynamic temporal interpretation contexts for temporal abstraction , 1998, Annals of Mathematics and Artificial Intelligence.

[52]  E. Carson,et al.  A probabilistic approach to glucose prediction and insulin dose adjustment: description of metabolic model and pilot evaluation study. , 1994, Computer methods and programs in biomedicine.

[53]  José Mira Mira,et al.  NasoNet, Joining Bayesian Networks and Time to Model Nasopharyngeal Cancer Spread , 2001, AIME.

[54]  Francisco Javier Díez,et al.  Efficient computation for the noisy MAX , 2003, Int. J. Intell. Syst..

[55]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[56]  Francisco Javier Díez,et al.  Networks of probabilistic events in discrete time , 2002, Int. J. Approx. Reason..

[57]  Shiliang Sun,et al.  A bayesian network approach to traffic flow forecasting , 2006, IEEE Transactions on Intelligent Transportation Systems.

[58]  Curtis E. Dyreson,et al.  Temporal Granularity , 1995, The TSQL2 Temporal Query Language.

[59]  M A Musen,et al.  Knowledge reuse: temporal-abstraction mechanisms for the assessment of children's growth. , 1993, Proceedings. Symposium on Computer Applications in Medical Care.

[60]  Francisco Javier Díez,et al.  Parameter adjustment in Bayes networks. The generalized noisy OR-gate , 1993, UAI.

[61]  Xavier Boyen,et al.  Tractable Inference for Complex Stochastic Processes , 1998, UAI.

[62]  Benoît Iung,et al.  Overview on Bayesian networks applications for dependability, risk analysis and maintenance areas , 2012, Eng. Appl. Artif. Intell..

[63]  Lawrence M. Fagan,et al.  Combining Physiologic Models and Symbolic Methods to Interpret Time-Varying Patient Data* , 1991, Methods of Information in Medicine.

[64]  Yuval Shahar Knowledge-based temporal interpolation , 1999, J. Exp. Theor. Artif. Intell..

[65]  Josef Kittler,et al.  Application of a Bayesian Network in a GIS Based Decision Making System , 1998, Int. J. Geogr. Inf. Sci..

[66]  Peter J. F. Lucas,et al.  A generic qualitative characterization of independence of causal influence , 2008, Int. J. Approx. Reason..

[67]  M A Musen,et al.  RESUME: a temporal-abstraction system for patient monitoring. , 1993, Computers and biomedical research, an international journal.

[68]  J. Rosenthal,et al.  Markov Chain Monte Carlo Methods , 2006 .

[69]  Elpida T. Keravnou,et al.  Temporal representation and reasoning in medicine: Research directions and challenges , 2006, Artif. Intell. Medicine.

[70]  Milos Hauskrecht,et al.  Multivariate Time Series Classification with Temporal Abstractions , 2009, FLAIRS.

[71]  Paul Dagum,et al.  Forecasting Sleep Apnea with Dynamic Network Models , 1993, UAI.

[72]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[73]  Christian Nøhr,et al.  Comparing Approaches to Measuring the Adoption and Usability of Electronic Health Records: Lessons Learned from Canada, Denmark and Finland , 2013, MedInfo.

[74]  Ling Liu,et al.  Encyclopedia of Database Systems , 2009, Encyclopedia of Database Systems.

[75]  James F. Allen Towards a General Theory of Action and Time , 1984, Artif. Intell..

[76]  Yuval Shahar,et al.  Probabilistic Abstraction of Multiple Longitudinal Electronic Medical Records , 2005, AIME.

[77]  Jianqing Fan,et al.  Statistical Estimation in Varying-Coefficient Models , 1999 .

[78]  Fabio Stella,et al.  A continuous time Bayesian network model for cardiogenic heart failure , 2012 .

[79]  Evert de Jonge,et al.  Prognostic Bayesian networks: I: Rationale, learning procedure, and clinical use , 2007, J. Biomed. Informatics.

[80]  Daphne Koller,et al.  Expectation Propagation for Continuous Time Bayesian Networks , 2005, UAI.

[81]  Carlo Berzuini Representing Time in Causal Probabilistic Networks , 1989, UAI.

[82]  Kim-Leng Poh,et al.  Time-Critical Dynamic Decision Making , 1999, UAI.

[83]  Peter J. F. Lucas,et al.  A dynamic Bayesian network for diagnosing ventilator-associated pneumonia in ICU patients , 2009, Expert Syst. Appl..

[84]  R. Tibshirani,et al.  Varying‐Coefficient Models , 1993 .

[85]  Carlo Combi,et al.  Data mining with Temporal Abstractions: learning rules from time series , 2007, Data Mining and Knowledge Discovery.

[86]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[87]  S. James Press Markov Chain Monte Carlo Methods , 2010 .

[88]  Elpida T. Keravnou,et al.  Intelligent Data Analysis for Medical Diagnosis: Using Machine Learning and Temporal Abstraction , 1998, AI Commun..

[89]  Samson W. Tu,et al.  RASTA: A Distributed Temporal Abstraction System to Facilitate Knowledge-Driven Monitoring of Clinical Databases , 2001, MedInfo.

[90]  François Charpillet,et al.  A dynamic Bayesian network for handling uncertainty in a decision support system adapted to the monitoring of patients treated by hemodialysis , 2005, 17th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'05).

[91]  Luis Enrique Sucar,et al.  Temporal Bayesian Network of Events for Diagnosis and Prediction in Dynamic Domains , 2005, Applied Intelligence.

[92]  Peter J. F. Lucas,et al.  Using a Bayesian-Network Model for the Analysis of Clinical Time-Series Data , 2005, AIME.

[93]  Alberto Riva,et al.  Temporal Abstractions for Interpreting Diabetic Patients Monitoring Data , 1998, Intell. Data Anal..

[94]  J. Fries,et al.  ARAMIS (the American Rheumatism Association Medical Information System). A prototypical national chronic-disease data bank. , 1986, The Western journal of medicine.

[95]  Yuval Shahar,et al.  Intelligent Interactive Visual Exploration of Temporal Associations among Multiple Time-oriented Patient Records , 2009, Methods of Information in Medicine.

[96]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[97]  Cungen Cao,et al.  Dynamic decision analysis in medicine: a data-driven approach , 1998, Int. J. Medical Informatics.

[98]  Keiji Kanazawa,et al.  A model for reasoning about persistence and causation , 1989 .

[99]  Lawrence M. Fagan,et al.  Extensions to the rule-based formalism for a monitoring task , 1984 .

[100]  John F. Roddick,et al.  ARMADA - An algorithm for discovering richer relative temporal association rules from interval-based data , 2007, Data Knowl. Eng..

[101]  Milos Hauskrecht,et al.  Planning treatment of ischemic heart disease with partially observable Markov decision processes , 2000, Artif. Intell. Medicine.

[102]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[103]  Evert de Jonge,et al.  Temporal abstraction for feature extraction: A comparative case study in prediction from intensive care monitoring data , 2007, Artif. Intell. Medicine.

[104]  Huifen Chen,et al.  Stochastic root finding via retrospective approximation , 2001 .

[105]  Nevin Lianwen Zhang,et al.  Exploiting Causal Independence in Bayesian Network Inference , 1996, J. Artif. Intell. Res..

[106]  Silja Renooij,et al.  Probabilities for a probabilistic network: a case study in oesophageal cancer , 2002, Artif. Intell. Medicine.

[107]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[108]  Yuval Shahar,et al.  Knowledge-based temporal abstraction in clinical domains , 1996, Artif. Intell. Medicine.

[109]  Daphne Koller,et al.  Continuous Time Bayesian Networks , 2012, UAI.

[110]  Yuval Shahar,et al.  Medical Temporal-Knowledge Discovery via Temporal Abstraction , 2009, AMIA.

[111]  Claus Skaanning,et al.  Markov Chain Monte Carlo Methods , 2006 .

[112]  Dimitrios Gunopulos,et al.  Mining frequent arrangements of temporal intervals , 2009, Knowledge and Information Systems.

[113]  Norman Fenton,et al.  Risk Assessment and Decision Analysis with Bayesian Networks , 2012 .

[114]  Silja Renooij,et al.  How to Elicit Many Probabilities , 1999, UAI.

[115]  C. Robert Discretization and Mcmc Convergence Assessment , 1998 .

[116]  Nir Friedman,et al.  Gibbs Sampling in Factorized Continuous-Time Markov Processes , 2008, UAI.

[117]  Yuval Shahar,et al.  A Framework for Knowledge-Based Temporal Abstraction , 1997, Artif. Intell..

[118]  Yuval Shahar,et al.  Irregular-Time Bayesian Networks , 2010, UAI.

[119]  David J. Spiegelhalter,et al.  Assessment, Criticism and Improvement of Imprecise Subjective Probabilities for a Medical Expert System , 2013, UAI.