BT-Nurse: computer generation of natural language shift summaries from complex heterogeneous medical data

The BT-Nurse system uses data-to-text technology to automatically generate a natural language nursing shift summary in a neonatal intensive care unit (NICU). The summary is solely based on data held in an electronic patient record system, no additional data-entry is required. BT-Nurse was tested for two months in the Royal Infirmary of Edinburgh NICU. Nurses were asked to rate the understandability, accuracy, and helpfulness of the computer-generated summaries; they were also asked for free-text comments about the summaries. The nurses found the majority of the summaries to be understandable, accurate, and helpful (p<0.001 for all measures). However, nurses also pointed out many deficiencies, especially with regard to extra content they wanted to see in the computer-generated summaries. In conclusion, natural language NICU shift summaries can be automatically generated from an electronic patient record, but our proof-of-concept software needs considerable additional development work before it can be deployed.

[1]  K. L. Moreland,et al.  Validation of computer-based test interpretations: problems and prospects. , 1985, Journal of consulting and clinical psychology.

[2]  J. I N Y U,et al.  Choosing the content of textual summaries of large time-series data sets , 2005 .

[3]  Mary Dee Harris,et al.  Building a Large-scale Commercial NLG System for an EMR , 2008, INLG.

[4]  Richard I. Kittredge,et al.  Using natural-language processing to produce weather forecasts , 1994, IEEE Expert.

[5]  Alain Polguère,et al.  Generation of Extended Bilingual Statistical Reports , 1992, COLING.

[6]  Avi Parush,et al.  Helping People with Visual Impairments Gain Access to Graphical Information Through Natural Language: The iGraph System , 2006, ICCHP.

[7]  Robert Dale,et al.  Building Natural Language Generation Systems: Figures , 2000 .

[8]  Anna S. Law,et al.  A Comparison of Graphical and Textual Presentations of Time Series Data to Support Medical Decision Making in the Neonatal Intensive Care Unit , 2005, Journal of Clinical Monitoring and Computing.

[9]  Wolfgang L. Zagler,et al.  Computers Helping People with Special Needs, 12th International Conference, ICCHP 2010, Vienna, Austria, July 14-16, 2010, Proceedings, Part II , 2010, ICCHP.

[10]  Albert Gatt,et al.  From data to text in the Neonatal Intensive Care Unit: Using NLG technology for decision support and information management , 2009, AI Commun..

[11]  Jim Hunter,et al.  Choosing words in computer-generated weather forecasts , 2005, Artif. Intell..

[12]  Ehud Reiter,et al.  Selecting the Content of Textual Descriptions of Geographically Located Events in Spatio-Temporal Weather Data , 2007, SGAI Conf..

[13]  Albert Gatt,et al.  SimpleNLG: A Realisation Engine for Practical Applications , 2009, ENLG.

[14]  Steven K. Feiner,et al.  MAGIC: an experimental system for generating multimedia briefings about post-bypass patient status. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[15]  Ehud Reiter,et al.  An Architecture for Data-to-Text Systems , 2007, ENLG.

[16]  R. Logie,et al.  When a graph is poorer than 100 words: A comparison of computerised natural language generation, human generated descriptions and graphical displays in neonatal intensive care , 2010 .

[17]  Richard Ellis,et al.  Applications and Innovations in Intelligent Systems VII , 2000, Springer London.

[18]  Anja Belz,et al.  Automatic generation of weather forecast texts using comprehensive probabilistic generation-space models , 2008, Natural Language Engineering.

[19]  Ron Artstein,et al.  Survey Article: Inter-Coder Agreement for Computational Linguistics , 2008, CL.

[20]  Albert Gatt,et al.  Automatic generation of textual summaries from neonatal intensive care data , 2009 .

[21]  Ehud Reiter,et al.  Book Reviews: Building Natural Language Generation Systems , 2000, CL.

[22]  Karen Kukich,et al.  Design of a Knowledge-Based Report Generator , 1983, ACL.