Enhancing human-machine teaming for medical prognosis through neural ordinary differential equations (NODEs)

Machine Learning (ML) has recently been demonstrated to rival expert-level human accuracy in prediction and detection tasks in a variety of domains, including medicine. Despite these impressive findings, however, a key barrier to the full realization of ML’s potential in medical prognoses is technology acceptance. Recent efforts to produce explainable AI (XAI) have made progress in improving the interpretability of some ML models, but these efforts suffer from limitations intrinsic to their design: they work best at identifying why a system fails, but do poorly at explaining when and why a model’s prediction is correct. We posit that the acceptability of ML predictions in expert domains is limited by two key factors: the machine’s horizon of prediction that extends beyond human capability, and the inability for machine predictions to incorporate human intuition into their models. We propose the use of a novel ML architecture, Neural Ordinary Differential Equations (NODEs) to enhance human understanding and encourage acceptability. Our approach prioritizes human cognitive intuition at the center of the algorithm design, and offers a 1Founder and CEO, PhD in Clinical Psychology, Myndblue 2PhD in Human-Computer Interaction, Lead Evaluator, DARPA Explainable AI Program 3Lead Data Scientist, PhD in Mathematics, Myndblue 4Biomedical Data Scientist, PhD in Computational Biology, Myndblue 5Machine Learning and Project Engineer, MSc in Applied Physics, Myndblue distribution of predictions rather than single outputs. We explain how this approach may significantly improve human-machine collaboration in prediction tasks in expert domains such as medical prognoses. We propose a model and demonstrate, by expanding a concrete example from the literature, how our model advances the vision of future hybrid Human-AI systems. Keywords— Expert System, Forecast, Ordinary Differential Equations, Neural Network, Variational Approach, Explainability, Acceptability, Intuition, Usability, Human-Machine Teaming Corresponding address: publishing@myndblue.ai

[1]  Jacques Laskar,et al.  The chaotic motion of the solar system: A numerical estimate of the size of the chaotic zones , 1990 .

[2]  David Duvenaud,et al.  Scalable Gradients for Stochastic Differential Equations , 2020, AISTATS.

[3]  Gwendolyn E. Campbell,et al.  Reentrant Processing in Intuitive Perception , 2010, PloS one.

[4]  N. McGlynn Thinking fast and slow. , 2014, Australian veterinary journal.

[5]  Robert G. Eggleston,et al.  Human–Machine Synergism in High-Level Cognitive Functioning: The Human Component , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[6]  G. Sussman,et al.  Chaotic Evolution of the Solar System , 1992, Science.

[7]  N. Pennington,et al.  Explaining the evidence: Tests of the Story Model for juror decision making. , 1992 .

[8]  Jimeng Sun,et al.  SDE-Net: Equipping Deep Neural Networks with Uncertainty Estimates , 2020, ICML.

[9]  Y. Ma Infinite Powers: How Calculus Reveals the Secrets of the Universe , 2019, Math Horizons.

[10]  J. Laskar A numerical experiment on the chaotic behaviour of the Solar System , 1989, Nature.

[11]  Francisco Herrera,et al.  Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI , 2020, Inf. Fusion.

[12]  Paul K J Han,et al.  Varieties of uncertainty in health care: a conceptual taxonomy. , 2011, Medical decision making : an international journal of the Society for Medical Decision Making.

[13]  Patrizia Busato,et al.  Machine Learning in Agriculture: A Review , 2018, Sensors.

[14]  Bin Dong,et al.  PDE-Net: Learning PDEs from Data , 2017, ICML.

[15]  F. Bouchet,et al.  Instantons for the Destabilization of the Inner Solar System. , 2019, Physical review letters.

[16]  S. Carey,et al.  Functional explanation and the function of explanation , 2006, Cognition.

[17]  C. McHorney,et al.  Frequency or Probability? A Qualitative Study of Risk Communication Formats Used in Health Care , 2001, Medical decision making : an international journal of the Society for Medical Decision Making.

[18]  Glenn J. Browne,et al.  Stopping information search: An fMRI investigation , 2021, Decis. Support Syst..

[19]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[20]  Robert Strauss Augmenting Neural Differential Equations to Model Unknown Dynamical Systems with Incomplete State Information , 2020, ArXiv.

[21]  Robert R. Hoffman,et al.  A Taxonomy of Emergent Trusting in the Human–Machine Relationship , 2017 .

[22]  G. Gigerenzer,et al.  Simple tools for understanding risks: from innumeracy to insight , 2003, BMJ : British Medical Journal.

[23]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[24]  Franz Wotawa,et al.  Quality assurance methodologies for automated driving , 2018, Elektrotech. Informationstechnik.

[25]  Frédéric Adam,et al.  Intuition in decision making - Risk and opportunity , 2020, J. Decis. Syst..

[26]  Bin Dong,et al.  PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Network , 2018, J. Comput. Phys..

[27]  Eric Vorm,et al.  Assessing Demand for Transparency in Intelligent Systems Using Machine Learning , 2018, 2018 Innovations in Intelligent Systems and Applications (INISTA).

[28]  Gerd Gigerenzer,et al.  Communicating Statistical Information , 2000, Science.

[29]  David Duvenaud,et al.  Neural Ordinary Differential Equations , 2018, NeurIPS.

[30]  Mark Conner,et al.  Does narrative information bias individual's decision making? A systematic review. , 2008, Social science & medicine.

[31]  Bruce G. Buchanan,et al.  The MYCIN Experiments of the Stanford Heuristic Programming Project , 1985 .

[32]  L. Loo,et al.  The Diagnosis, Prognosis, and Treatment of Medical Uncertainty. , 2015, Journal of graduate medical education.

[33]  Peter Pirolli,et al.  Information Foraging , 2009, Encyclopedia of Database Systems.

[34]  Stephen Porter,et al.  Dangerous decisions: A theoretical framework for understanding how judges assess credibility in the courtroom , 2009 .

[35]  Amit Chakraborty,et al.  Symplectic ODE-Net: Learning Hamiltonian Dynamics with Control , 2020, ICLR.

[36]  Jerad H. Moxley,et al.  The role of intuition and deliberative thinking in experts’ superior tactical decision-making , 2012, Cognition.

[37]  Andrew Y. Ng,et al.  Improving palliative care with deep learning , 2017, 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[38]  E. Salas,et al.  Expertise-Based Intuition and Decision Making in Organizations , 2010 .

[39]  David Duvenaud,et al.  Latent ODEs for Irregularly-Sampled Time Series , 2019, ArXiv.

[40]  I. Gauthier,et al.  Visual object understanding , 2004, Nature Reviews Neuroscience.