Towards Automated Classification of Intensive Care Nursing Narratives

BACKGROUND Nursing narratives are an important part of patient documentation, but the possibilities to utilize them in the direct care process are limited due to the lack of proper tools. One solution to facilitate the utilization of narrative data could be to classify them according to their content. OBJECTIVES Our objective is to address two issues related to designing an automated classifier: domain experts' agreement on the content of classes Breathing, Blood Circulation and Pain, as well as the ability of a machine-learning-based classifier to learn the classification patterns of the nurses. METHODS The data we used were a set of Finnish intensive care nursing narratives, and we used the regularized least-squares (RLS) algorithm for the automatic classification. The agreement of the nurses was assessed by using Cohen's kappa, and the performance of the algorithm was measured using area under ROC curve (AUC). RESULTS On average, the values of kappa were around 0.8. The agreement was highest in the class Blood Circulation, and lowest in the class Breathing. The RLS algorithm was able to learn the classification patterns of the three nurses on an acceptable level; the values of AUC were generally around 0.85. CONCLUSIONS Our results indicate that the free text in nursing documentation can be automatically classified and this can offer a way to develop electronic patient records.

[1]  K Nojonen,et al.  Validation of a new method for patient classification, the Oulu Patient Classification. , 2000, Journal of advanced nursing.

[2]  Barbara Di Eugenio,et al.  Squibs and Discussions: The Kappa Statistic: A Second Look , 2004, CL.

[3]  Kathy Smith,et al.  Evaluating the Impact of Computerized Clinical Documentation , 2005, Computers, informatics, nursing : CIN.

[4]  Mark R Lehto,et al.  Computerized coding of injury narrative data from the National Health Interview Survey. , 2004, Accident; analysis and prevention.

[5]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[6]  Tapio Salakoski,et al.  Relevance Ranking of Intensive Care Nursing Narratives , 2006, KES.

[7]  Peter J. Haug,et al.  Classifying free-text triage chief complaints into syndromic categories with natural language processing , 2005, Artif. Intell. Medicine.

[8]  T. Poggio,et al.  The Mathematics of Learning: Dealing with Data , 2005, 2005 International Conference on Neural Networks and Brain.

[9]  George Hripcsak,et al.  Reference Standards, Judges, and Comparison Subjects , 2002 .

[10]  George Hripcsak,et al.  Research Paper: A Reliability Study for Evaluating Information Extraction from Radiology Reports , 1999, J. Am. Medical Informatics Assoc..

[11]  Bernhard Schölkopf,et al.  A Generalized Representer Theorem , 2001, COLT/EuroCOLT.

[12]  Jean-Luc Bosson,et al.  Assessing pain in critically ill sedated patients by using a behavioral pain scale , 2001, Critical care medicine.

[13]  George Hripcsak,et al.  Review Paper: Reference Standards, Judges, and Comparison Subjects: Roles for Experts in Evaluating System Performance , 2002, J. Am. Medical Informatics Assoc..

[14]  Christopher G. Chute,et al.  Using Compund Codes for Automatic Classification of Clinical Diagnoses , 2004, MedInfo.

[15]  Carol Friedman,et al.  ISO reference terminology models for nursing: Applicability for natural language processing of nursing narratives , 2005, Int. J. Medical Informatics.

[16]  S Corcoran-Perry,et al.  Developing clinical practice environments supporting the knowledge work of nurses. , 2001, Computers in nursing.

[17]  Wendy W. Chapman,et al.  Fever detection from free-text clinical records for biosurveillance , 2004, Journal of Biomedical Informatics.

[18]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machines , 2002 .

[19]  Charles P. Friedman,et al.  Evaluation Methods in Medical Informatics , 1997, Computers and Medicine.

[20]  Jean Carletta,et al.  Assessing Agreement on Classification Tasks: The Kappa Statistic , 1996, CL.

[21]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[22]  Robert H. Baud,et al.  Recent advances in natural language processing for biomedical applications , 2006, Int. J. Medical Informatics.

[23]  Tomaso Poggio,et al.  Everything old is new again: a fresh look at historical approaches in machine learning , 2002 .

[24]  Nicholas S Ward,et al.  Comparison of a commercially available clinical information system with other methods of measuring critical care outcomes data. , 2004, Journal of critical care.

[25]  G. Pierpont,et al.  Effect of computerized charting on nursing activity in intensive care. , 1995, Critical care medicine.

[26]  Tapio Salakoski,et al.  Fast n-Fold Cross-Validation for Regularized Least-Squares , 2006 .