Modeling longitudinal dynamics of comorbidities

In medicine, comorbidities refer to the presence of multiple, co-occurring diseases. Due to their co-occurring nature, the course of one comorbidity is often highly dependent on the course of the other disease and, hence, treatments can have significant spill-over effects. Despite the prevalence of comorbidities among patients, a comprehensive statistical framework for modeling the longitudinal dynamics of comorbidities is missing. In this paper, we propose a probabilistic model for analyzing comorbidity dynamics over time in patients. Specifically, we develop a coupled hidden Markov model with a personalized, non-homogeneous transition mechanism, named Comorbidity-HMM. The specification of our Comorbidity-HMM is informed by clinical research: (1) It accounts for different disease states (i. e., acute, stable) in the disease progression by introducing latent states that are of clinical meaning. (2) It models a coupling among the trajectories from comorbidities to capture co-evolution dynamics. (3) It considers between-patient heterogeneity (e. g., risk factors, treatments) in the transition mechanism. Based on our model, we define a spill-over effect that measures the indirect effect of treatments on patient trajectories through coupling (i. e., through comorbidity co-evolution). We evaluated our proposed Comorbidity-HMM based on 675 health trajectories where we investigate the joint progression of diabetes mellitus and chronic liver disease. Compared to alternative models without coupling, we find that our Comorbidity-HMM achieves a superior fit. Further, we quantify the spill-over effect, that is, to what extent diabetes treatments are associated with a change in the chronic liver disease from an acute to a stable disease state. To this end, our model is of direct relevance for both treatment planning and clinical research in the context of comorbidities.

[1]  Jiqiang Guo,et al.  Stan: A Probabilistic Programming Language. , 2017, Journal of statistical software.

[2]  J. Twisk,et al.  Longitudinal relationship between pain and depression in older adults: sex, age and physical disability , 2002, Social Psychiatry and Psychiatric Epidemiology.

[3]  Anna Maria Paganoni,et al.  Multivariate Hidden Markov Models for disease progression , 2020, Stat. Anal. Data Min..

[4]  N. Bartolomeo,et al.  Progression of liver cirrhosis to HCC: an application of hidden Markov model , 2011, BMC medical research methodology.

[5]  I. Hickman,et al.  Impact of diabetes on the severity of liver disease. , 2007, The American journal of medicine.

[6]  Simon G. Thompson,et al.  Multistate Markov models for disease progression with classification error , 2003 .

[7]  J. Valderas,et al.  Five-year trajectories of multimorbidity patterns in an elderly Mediterranean population using Hidden Markov Models , 2020, Scientific Reports.

[8]  Ames,et al.  Hidden Markov Models for Longitudinal Comparisons , 2004 .

[9]  Aki Vehtari,et al.  Visualization in Bayesian workflow , 2017, Journal of the Royal Statistical Society: Series A (Statistics in Society).

[10]  Depeng Jin,et al.  Understanding Urban Dynamics via State-Sharing Hidden Markov Model , 2019, IEEE Transactions on Knowledge and Data Engineering.

[11]  G. Nijpels,et al.  Distinct HbA1c trajectories in a type 2 diabetes cohort , 2015, Acta Diabetologica.

[12]  Jimeng Sun,et al.  TASTE: temporal and static tensor factorization for phenotyping electronic health records , 2019, CHIL.

[13]  Craig K. Enders,et al.  Centering predictor variables in cross-sectional multilevel models: a new look at an old issue. , 2007, Psychological methods.

[14]  Zoubin Ghahramani,et al.  An Introduction to Hidden Markov Models and Bayesian Networks , 2001, Int. J. Pattern Recognit. Artif. Intell..

[15]  W. Zucchini,et al.  Hidden Markov Models for Time Series: An Introduction Using R , 2009 .

[16]  Jeff Craley,et al.  A Novel Method for Epileptic Seizure Detection Using Coupled Hidden Markov Models , 2018, MICCAI.

[17]  K. Jones,et al.  Explaining Fixed Effects: Random Effects Modeling of Time-Series Cross-Sectional and Panel Data* , 2014, Political Science Research and Methods.

[18]  Mary Jo Pugh,et al.  Mining patterns of comorbidity evolution in patients with multiple chronic conditions using unsupervised multi-level temporal Bayesian network , 2018, PloS one.

[19]  Lijuan Peggy Wang,et al.  On disaggregating between-person and within-person effects with longitudinal data using multilevel models. , 2015, Psychological methods.

[20]  S. Roberts,et al.  Estimation of coupled hidden Markov models with application to biosignal interaction modelling , 2000, Neural Networks for Signal Processing X. Proceedings of the 2000 IEEE Signal Processing Society Workshop (Cat. No.00TH8501).

[21]  D. Omdahl Unending Work and Care: Managing Chronic Illness at Home , 1989 .

[22]  Elizabeth H. Harris Elevated Liver Function Tests in Type 2 Diabetes , 2005 .

[23]  R. Altman Mixed Hidden Markov Models , 2007 .

[24]  Giampiero M. Gallo,et al.  Volatility spillovers, interdependence and comovements: A Markov Switching approach , 2008, Comput. Stat. Data Anal..

[25]  Yanwei Zhang,et al.  Disease progression modeling using Hidden Markov Models , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Stefan Feuerriegel,et al.  Early Detection of User Exits from Clickstream Data: A Markov Modulated Marked Point Process Model , 2020, WWW.

[27]  Debbie,et al.  The British Women’s Heart and Health Study and meta-analysis , 2018 .

[28]  Amir Hassan Zadeh,et al.  Predicting overall survivability in comorbidity of cancers: A data mining approach , 2015, Decis. Support Syst..

[29]  C. Bogardus,et al.  High alanine aminotransferase is associated with decreased hepatic insulin sensitivity and predicts the development of type 2 diabetes. , 2002, Diabetes.

[30]  Aki Vehtari,et al.  Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC , 2015, Statistics and Computing.

[31]  M. Gebregziabher,et al.  Longitudinal effects of depression on glycemic control in veterans with Type 2 diabetes. , 2008, General hospital psychiatry.

[32]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  D. Borsboom,et al.  A Network Approach to Psychopathology: New Insights into Clinical Longitudinal Data , 2013, PloS one.

[34]  W. Satariano,et al.  Causes and consequences of comorbidity: a review. , 2001, Journal of clinical epidemiology.

[35]  A. Strauss,et al.  A nursing model for chronic illness management based upon the Trajectory Framework. , 1991, Scholarly inquiry for nursing practice.

[36]  Christopher H Jackson,et al.  Hidden Markov models for the onset and progression of bronchiolitis obliterans syndrome in lung transplant recipients , 2002, Statistics in medicine.

[37]  Stefan Feuerriegel,et al.  Estimating Risk-Adjusted Hospital Performance , 2020, 2020 IEEE International Conference on Big Data (Big Data).

[38]  B. Penninx,et al.  Comorbidity between depression and anxiety: assessing the role of bridge mental states in dynamic psychological networks , 2020, BMC Medicine.

[39]  Ellen L. Hamaker,et al.  UvA-DARE ( Digital Academic Repository ) To center or not to center ? Investigating inertia with a multilevel autoregressive model , 2014 .

[40]  Keith G. Tolman,et al.  Spectrum of Liver Disease in Type 2 Diabetes and Management of Patients With Diabetes and Liver Disease , 2007 .

[41]  Rakesh Dugad,et al.  A Tutorial On Hidden Markov Models , 1996 .

[42]  Peter J. F. Lucas,et al.  Multilevel Bayesian networks for the analysis of hierarchical health care data , 2013, Artif. Intell. Medicine.

[43]  Stefan Visscher,et al.  Multilevel temporal Bayesian networks can model longitudinal change in multimorbidity. , 2013, Journal of clinical epidemiology.

[44]  C. Mackenzie,et al.  A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. , 1987, Journal of chronic diseases.

[45]  W. Katon,et al.  Depression and pain comorbidity: a literature review. , 2003, Archives of internal medicine.

[46]  S. Chuang,et al.  Longitudinal transition trajectory of gouty arthritis and its comorbidities: a population-based study , 2017, Rheumatology International.

[47]  Stefan Feuerriegel,et al.  AttDMM: An Attentive Deep Markov Model for Risk Scoring in Intensive Care Units , 2021, KDD.

[48]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[49]  Ahmed M. Alaa,et al.  Learning Dynamic and Personalized Comorbidity Networks from Event Data using Deep Diffusion Processes , 2020, AISTATS.

[50]  Steven Piantadosi,et al.  The prevalence of psychological distress by cancer site , 2001, Psycho-oncology.

[51]  Vianey Leos-Barajas,et al.  An Introduction to Animal Movement Modeling with Hidden Markov Models using Stan for Bayesian Inference , 2018 .

[52]  Dylan S. Small,et al.  HIDDEN MARKOV MODELS FOR ALCOHOLISM TREATMENT TRIAL DATA , 2010, 1010.1410.

[53]  Martin L. Puterman,et al.  Analysis of longitudinal data of epileptic seizure counts: A two-state hidden Markov regression approach , 2001 .

[54]  Wei Zhang,et al.  Adverse drug reaction discovery from electronic health records with deep neural networks , 2020, CHIL.

[55]  G. Marchesini,et al.  A Randomized Controlled Trial of Metformin versus Vitamin E or Prescriptive Diet in Nonalcoholic Fatty Liver Disease , 2005, The American Journal of Gastroenterology.

[56]  B. Starfield,et al.  Defining Comorbidity: Implications for Understanding Health and Health Services , 2009, The Annals of Family Medicine.

[57]  S. Wyke,et al.  Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study , 2012, The Lancet.

[58]  Marios Kokkodis,et al.  Dynamic Recommendations for Sequential Hiring Decisions in Online Labor Markets , 2018, KDD.

[59]  Kristy Iglay,et al.  Prevalence and co-prevalence of comorbidities among patients with type 2 diabetes mellitus , 2016, Current medical research and opinion.

[60]  Linda C. van der Gaag,et al.  Probabilistic Graphical Models , 2014, Lecture Notes in Computer Science.

[61]  Simon E. F. Spencer,et al.  Scalable Bayesian Inference for Coupled Hidden Markov and Semi-Markov Models , 2019, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America.

[62]  A. Roso-Llorach,et al.  Multimorbidity patterns in the elderly: a prospective cohort study with cluster analysis , 2018, BMC Geriatrics.

[63]  A R Feinstein,et al.  THE PRE-THERAPEUTIC CLASSIFICATION OF CO-MORBIDITY IN CHRONIC DISEASE. , 1970, Journal of chronic diseases.

[64]  Ajay Jasra,et al.  Markov Chain Monte Carlo Methods and the Label Switching Problem in Bayesian Mixture Modeling , 2005 .

[65]  Stefan Feuerriegel,et al.  Longitudinal healthcare analytics for disease management: Empirical demonstration for low back pain , 2020, Decis. Support Syst..

[66]  B. Starfield,et al.  Prevalence, expenditures, and complications of multiple chronic conditions in the elderly. , 2002, Archives of internal medicine.

[67]  Tatiana Xifara,et al.  A coupled hidden Markov model for disease interactions , 2012, Journal of the Royal Statistical Society. Series C, Applied statistics.

[68]  Daniel J. Bauer,et al.  The disaggregation of within-person and between-person effects in longitudinal models of change. , 2011, Annual review of psychology.

[69]  R. Stawski,et al.  Persons as Contexts: Evaluating Between-Person and Within-Person Effects in Longitudinal Analysis , 2009 .

[70]  A. Sanyal,et al.  MAFLD: A consensus-driven proposed nomenclature for metabolic associated fatty liver disease. , 2020, Gastroenterology.

[71]  P. Villari,et al.  Comorbidity, Hospitalization, and Mortality in COPD: Results from a Longitudinal Study , 2010, Lung.

[72]  Stefan Feuerriegel,et al.  Estimating Average Treatment Effects via Orthogonal Regularization , 2021, CIKM.

[73]  Mihaela van der Schaar,et al.  A primer on coupled state-switching models for multiple interacting time series , 2020, Statistical Modelling.

[74]  Kevin P. Murphy,et al.  A coupled HMM for audio-visual speech recognition , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[75]  Andrew Gelman,et al.  The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo , 2011, J. Mach. Learn. Res..

[76]  Alex Pentland,et al.  Graph-Coupled HMMs for Modeling the Spread of Infection , 2012, UAI.

[77]  William W Eaton,et al.  Heterogeneity in 10-Year Course Trajectories of Moderate to Severe Major Depressive Disorder: A Danish National Register-Based Study. , 2016, JAMA psychiatry.

[78]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.