Automatic Generation of Textual Summaries from Neonatal Intensive Care Data

Intensive care is becoming increasingly complex. If mistakes are to be avoided, there is a need for the large amount of clinical data to be presented effectively to the medical staff. Although the most common approach is to present the data graphically, it has been shown that textual summarisation can lead to improved decision making. As the first step in the BabyTalk project, a prototype is being developed which will generate a textual summary of 45 minutes of continuous physiological signals and discrete events (e.g.: equipment settings and drug administration). Its architecture brings together techniques from the different areas of signal analysis, medical reasoning, and natural language generation. Although the current system is still being improved, it is powerful enough to generate meaningful texts containing the most relevant information. This prototype will be extended to summarize several hours of data and to include clinical interpretation.

[1]  P. Sánchez,et al.  VISUALIZATION METHODS FOR TIME-DEPENDENT DATA-AN OVERVIEW , 2003 .

[2]  Joa Sang Lim,et al.  Judgmental forecasting with time series and causal information , 1996 .

[3]  Chris Mellish,et al.  Choosing the content of textual summaries of large time-series data sets , 2006, Natural Language Engineering.

[4]  Donia Scott,et al.  Structural variation in generated health reports , 2005, IWP@IJCNLP.

[5]  Zeno Vendler,et al.  Verbs and Times , 1957, The Language of Time - A Reader.

[6]  Dirk Kraus,et al.  Suregen-2: a shell system for the generation of clinical documents , 2003, EACL.

[7]  Judith Masthoff,et al.  What Do You Want to Know? Investigating the Information Requirements of Patient Supporters , 2008, 2008 21st IEEE International Symposium on Computer-Based Medical Systems.

[8]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[9]  Jim Hunter,et al.  Choosing words in computer-generated weather forecasts , 2005, Artif. Intell..

[10]  N. McIntosh,et al.  Intra-arterial blood pressure reference ranges, death and morbidity in very low birthweight infants during the first seven days of life. , 1999, Early human development.

[11]  G. Carrault,et al.  Algorithm fusion for the early detection of apnea-bradycardia in preterm infants , 2006, 2006 Computers in Cardiology.

[12]  S W Hoare,et al.  Automatic artifact identification in anaesthesia patient record keeping: a comparison of techniques. , 2000, Medical engineering & physics.

[13]  Richard I. Kittredge,et al.  Using natural-language processing to produce weather forecasts , 1994, IEEE Expert.

[14]  Catherine Plaisant,et al.  The challenge of information visualization evaluation , 2004, AVI.

[15]  Ehud Reiter,et al.  SumTime-Mousam: Configurable marine weather forecast generator , 2003 .

[16]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[17]  Emiel Krahmer,et al.  Efficient context-sensitive generation of referring expressions , 2002 .

[18]  Bernadette Strople,et al.  Can technology improve intershift report? What the research reveals. , 2006, Journal of professional nursing : official journal of the American Association of Colleges of Nursing.

[19]  Wolfgang Jank,et al.  Representing Unevenly-Spaced Time Series Data for Visualization and Interactive Exploration , 2005, INTERACT.

[20]  Ehud Reiter,et al.  Lessons from a failure: Generating tailored smoking cessation letters , 2003, Artif. Intell..

[21]  R. Power,et al.  Summarisation and Visualisation of e-Health Data Repositories , 2005 .

[22]  Alison Cawsey,et al.  The Evaluation of a Personalised Health Information System for Patients with Cancer , 2000, User Modeling and User-Adapted Interaction.

[23]  Yuval Shahar,et al.  Distributed, intelligent, interactive visualization and exploration of time-oriented clinical data and their abstractions , 2006, Artif. Intell. Medicine.

[24]  Albert Gatt,et al.  Automatic generation of textual summaries from neonatal intensive care data , 2009 .

[25]  Frank Puppe,et al.  Application and Evaluation of a Medical Knowledge System in Sonography (SONOCONSULT) , 2008, ECAI.

[26]  Ehud Reiter,et al.  Book Reviews: Building Natural Language Generation Systems , 2000, CL.

[27]  Rafael Pérez y Pérez,et al.  Three computer-based models of storytelling: BRUTUS, MINSTREL and MEXICA , 2004, Knowl. Based Syst..

[28]  Karen Kukich,et al.  Design of a Knowledge-Based Report Generator , 1983, ACL.

[29]  William Winn,et al.  Chapter 1 Contributions of Perceptual and Cognitive Processes to the Comprehension of Graphics , 1994 .

[30]  Bonnie L. Webber,et al.  The Interpretation of Tense in Discourse , 1987, ACL.

[31]  Mark Steedman,et al.  Temporal Ontology and Temporal Reference , 1988, CL.

[32]  N. McIntosh,et al.  A randomized, controlled trial of computerized physiologic trend monitoring in an intensive care unit. , 1998, Critical care medicine.

[33]  Chris Mellish,et al.  Neonatal Intensive Care Information for Parents An Affective Approach , 2008, 2008 21st IEEE International Symposium on Computer-Based Medical Systems.

[34]  Anna S. Law,et al.  A Comparison of Graphical and Textual Presentations of Time Series Data to Support Medical Decision Making in the Neonatal Intensive Care Unit , 2005, Journal of Clinical Monitoring and Computing.

[35]  Didier Dubois,et al.  Fuzziness and Uncertainty in Temporal Reasoning , 2003, J. Univers. Comput. Sci..

[36]  Daniela Fogli,et al.  Toward overcoming culture, skill and situation hurdles in Human-Computer Interaction , 2002, Universal Access in the Information Society.

[37]  Kees van Deemter,et al.  Incremental Generation of Plural Descriptions: Similarity and Partitioning , 2007, EMNLP-CoNLL.

[38]  José Coch System Demonstration Interactive Generation And Knowledge Administration In Multimeteo , 1998, INLG.

[39]  Michael Lawrence,et al.  The effects of structural characteristics of explanations on use of a DSS , 2006, Decis. Support Syst..

[40]  M Dojat,et al.  Using a general theory of time and change in patient monitoring: Experiment and evaluation , 1997, Comput. Biol. Medicine.

[41]  Robert Dale,et al.  Computational Interpretations of the Gricean Maxims in the Generation of Referring Expressions , 1995, Cogn. Sci..

[42]  Gary Ewing,et al.  The NEONATE Database , 2003 .

[43]  Regina Barzilay,et al.  Inducing Temporal Graphs , 2006, EMNLP.

[44]  Rebecca J. Passonneau,et al.  Situations and Intervals , 1987, ACL.

[45]  M A Musen,et al.  RESUME: a temporal-abstraction system for patient monitoring. , 1993, Computers and biomedical research, an international journal.

[46]  Ehud Reiter,et al.  Configurable Marine Weather Forecast Generator , 2003 .

[47]  Fred D. Davis,et al.  Determinants of Decision Rule Use in a Production Planning Task , 1995 .

[48]  Ehud Reiter,et al.  Selecting the Content of Textual Descriptions of Geographically Located Events in Spatio-Temporal Weather Data , 2007, SGAI Conf..

[49]  Ben Shneiderman,et al.  Interactive pattern search in time series , 2005, IS&T/SPIE Electronic Imaging.

[50]  Eamonn J. Keogh,et al.  An online algorithm for segmenting time series , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[51]  Jim Hunter,et al.  Segmenting Time Series for Weather Forecasting , 2003 .

[52]  Carolyn McGregor,et al.  Temporal abstraction in intelligent clinical data analysis: A survey , 2007, Artif. Intell. Medicine.

[53]  Martha Palmer,et al.  Class-Based Construction of a Verb Lexicon , 2000, AAAI/IAAI.

[54]  S Miksch,et al.  Effective data validation of high-frequency data: Time-point-, time-interval-, and trend-based methods , 1997, Comput. Biol. Medicine.

[55]  Mary Dee Harris,et al.  Building a Large-scale Commercial NLG System for an EMR , 2008, INLG.

[56]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[57]  M. Reape,et al.  Just what is aggregation anyway ? , 2007 .

[58]  K. Spackman SNOMED RT and SNOMEDCT. Promise of an international clinical terminology. , 2000, M.D. computing : computers in medical practice.

[59]  Silvia Miksch,et al.  Temporal Dimension of Medical Guidelines : The Semantics of Asbru Time Annotations , 2006 .

[60]  Yuval Shahar,et al.  Evaluation of an architecture for intelligent query and exploration of time-oriented clinical data , 2008, Artif. Intell. Medicine.

[61]  Panagiotis Stamatopoulos,et al.  Summarization from Medical Documents: A Survey , 2005, Artif. Intell. Medicine.

[62]  O. M.O.D ILEX: An Architecture for a Dynamic Hypertext Generation System , 2001 .

[63]  Evert de Jonge,et al.  An empirical comparison of four procedures for filtering monitoring data , 2007 .

[64]  Avi Parush,et al.  Helping People with Visual Impairments Gain Access to Graphical Information Through Natural Language: The iGraph System , 2006, ICCHP.

[65]  B. Partee Some Structural Analogies between Tenses and Pronouns in English , 1973 .

[66]  Leo Wanner,et al.  Automatic Production of Multilingual Environmental Information , 2007, EnviroInfo.

[67]  Gary Ewing,et al.  NEONATE: Decision Support in the Neonatal Intensive Care Unit - A Preliminary Report , 2003, AIME.

[68]  Ernest Friedman Hill,et al.  Jess in Action: Java Rule-Based Systems , 2003 .

[69]  J Sahuquillo,et al.  Does multimodality monitoring make a difference in neurocritical care? , 2008, European journal of anaesthesiology. Supplement.

[70]  Heidrun Schumann,et al.  Visualizing time-oriented data - A systematic view , 2007, Comput. Graph..

[71]  Jenny Waycott,et al.  Effects of advance organizers, mental models and abilities on task and recall performance using a mobile phone network , 2006 .

[72]  J. I N Y U,et al.  Choosing the content of textual summaries of large time-series data sets , 2005 .

[73]  Ben Shneiderman,et al.  Maintaining concentration to achieve task completion , 2005, DUX '05.

[74]  F. Portet,et al.  Evaluation of On-Line Bradycardia Boundary Detectors from Neonatal Clinical Data , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[75]  Alain Polguère,et al.  Generation of Extended Bilingual Statistical Reports , 1992, COLING.

[76]  J. Quinn Bayesian Condition Monitoring in Neonatal Intensive Care , 2007 .

[77]  Ehud Reiter,et al.  An Architecture for Data-to-Text Systems , 2007, ENLG.

[78]  B L Humphreys,et al.  The UMLS project: making the conceptual connection between users and the information they need. , 1993, Bulletin of the Medical Library Association.

[79]  Ben Shneiderman,et al.  Inventing Discovery Tools: Combining Information Visualization with Data Mining1 , 2001, Inf. Vis..

[80]  James C. Lester,et al.  Narrative prose generation , 2001, Artif. Intell..

[81]  Gilhooley,et al.  The cognitive processes of doctors and nurses in the interpretation of physiological monitoring data in the neonate , 2000, Early human development.

[82]  James Pustejovsky,et al.  The syntax of event structure , 1991, Cognition.

[84]  Jim Hunter,et al.  TSNet - A Distributed Architecture for Time Series Analysis , 2008, Computer-based Medical Guidelines and Protocols.

[85]  François Pachet,et al.  NéoGanesh: a working system for the automated control of assisted ventilation in ICUs , 1997, Artif. Intell. Medicine.

[86]  Jim Hunter,et al.  Knowledge-Based Event Detection in Complex Time Series Data , 1999, AIMDM.

[87]  Jim Hunter,et al.  Medical cognition and computer support in the intensive care unit: A cognitive engineering approach. , 1997 .

[88]  Lawrence M. Fagan,et al.  Combining Physiologic Models and Symbolic Methods to Interpret Time-Varying Patient Data* , 1991, Methods of Information in Medicine.

[89]  Hans Reichenbach,et al.  Elements of symbolic logic , 1948 .

[90]  Thomas Rist,et al.  Generating coherent presentations employing textual and visual material , 1995, Artificial Intelligence Review.

[91]  Kees van Deemter,et al.  Information sharing : reference and presupposition in language generation and interpretation , 2002 .

[92]  J. D. Di Fiore,et al.  Neonatal cardiorespiratory monitoring techniques. , 2004, Seminars in neonatology : SN.

[93]  James Pustejovsky,et al.  Machine Learning of Temporal Relations , 2006, ACL.

[94]  Samson W. Tu,et al.  Protégé-2000: An Open-Source Ontology-Development and Knowledge-Acquisition Environment: AMIA 2003 Open Source Expo , 2003, AMIA.

[95]  D Hüske-Kraus,et al.  Text Generation in Clinical Medicine – a Review , 2003, Methods of Information in Medicine.