A systematic review of interrater reliability of pressure ulcer classification systems.

AIMS To review systematically the interrater reliability of pressure ulcer classification systems to find out which classification should be used in daily practice. BACKGROUND Pressure ulcer classification systems are important tools in research and practice. They aim at providing accurate and precise communication, documentation and treatment decisions. Pressure ulcer classifications are criticised for their low degree of interrater reliability. DESIGN Systematic review. METHODS The data bases MEDLINE, EMBASE, CINAHL and the World Wide Web were searched. Original research studies estimating interrater reliability of pressure ulcer classification systems were included. Study selection, data extraction and quality assessment was conducted independently by two reviewers. RESULTS Twenty-four out of 339 potentially relevant studies were included in the final data synthesis. Due to the heterogeneity of the studies a meaningful comparison was impossible. CONCLUSIONS There is at present not enough evidence to recommend a specific pressure ulcer classification system for use in daily practice. Interrater reliability studies are required, in which comparable raters apply different pressure ulcer classification systems to comparable samples. RELEVANCE TO CLINICAL PRACTICE It is necessary to determine the interrater reliability of pressure ulcer classifications among all users in clinical practice. If interrater reliability is low the use of those systems is questionable. On the basis of this review there are no recommendations as to which system is to be given preference.

[1]  Robert A Lowe,et al.  Use of photographs for the identification of pressure ulcers in elderly hospitalized patients: validity and reliability , 2006, Wound repair and regeneration : official publication of the Wound Healing Society [and] the European Tissue Repair Society.

[2]  J. D. Shea.  Pressure sores: classification and management. , 1975, Clinical orthopaedics and related research.

[3]  C. Dealey,et al.  Pressure Ulcer Classification , 2006 .

[4]  S. Masonb,et al.  A sequential randomised controlled trial comparing a dry Viscoelastic polymer pad and standard operating table Mattress in the prevention of post-operative pressure sores , 2005 .

[5]  H K Suen,et al.  Agreement, reliability, accuracy, and validity: Toward a clarification. , 1988 .

[6]  S. Bergquist,et al.  Subscales, Subscores, or Summative Score: Evaluating the Contribution of Braden Scale Items for Predicting Pressure Ulcer Risk in Older Adults Receiving Home Health Care , 2001, Journal of wound, ostomy, and continence nursing : official publication of The Wound, Ostomy and Continence Nurses Society.

[7]  R. Frantz,et al.  Pressure ulcers in community-based older adults receiving home health care. Prevalence, incidence, and associated risk factors. , 1999, Advances in wound care : the journal for prevention and healing.

[8]  N. Draper,et al.  Applied Regression Analysis , 1966 .

[9]  W. Grove.  Statistical Methods for Rates and Proportions, 2nd ed , 1981 .

[10]  J. Barbenel,et al.  INCIDENCE OF PRESSURE-SORES IN THE GREATER GLASGOW HEALTH BOARD AREA , 1977, The Lancet.

[11]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[12]  Byron J Gajewski,et al.  Inter‐rater reliability of pressure ulcer staging: ordinal probit Bayesian hierarchical model that allows for uncertain rater response , 2007, Statistics in medicine.

[13]  Graham Dunn,et al.  Statistical Evaluation of Measurement Errors: Design and Analysis of Reliability Studies , 2004 .

[14]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[15]  J. Arends,et al.  Is the distinction between superficial pressure ulcers and moisture lesions justifiable? A clinical-pathologic study. , 2007, Skinmed.

[16]  M. Golberg,et al.  The Prevalence of Pressure Ulcers in a Tertiary Care Pediatric and Adult Hospital , 2004, Journal of wound, ostomy, and continence nursing : official publication of The Wound, Ostomy and Continence Nurses Society.

[17]  Nina Engelhardt,et al.  Rater Training in Multicenter Clinical Trials: Issues and Recommendations , 2004, Journal of clinical psychopharmacology.

[18]  D. Langemo,et al.  National Pressure Ulcer Advisory Panel's updated pressure ulcer staging system. , 2007, Advances in skin & wound care.

[19]  R. Allman,et al.  Pressure ulcer prevalence, incidence, risk factors, and impact. , 1997, Clinics in geriatric medicine.

[20]  L. Russell.  Pressure ulcer classification: the systems and the pitfalls. , 2002, British journal of nursing.

[21]  Helena Chmura Kraemer,et al.  Kappa coefficients in medical research , 2002, Statistics in medicine.

[22]  C. Noonan,et al.  Skin integrity in hospitalized infants and children: a prevalence survey. , 2006, Journal of pediatric nursing.

[23]  C. Lyder,et al.  The Braden Scale for pressure ulcer risk: evaluating the predictive validity in Black and Latino/Hispanic elders. , 1999, Applied nursing research : ANR.

[24]  Erik Buskens,et al.  Risk indicators for pressure ulcers during surgery. , 2002, Applied nursing research : ANR.

[25]  T. Defloor,et al.  Non-blanchable erythema as an indicator for the need for pressure ulcer prevention: a randomized-controlled trial. , 2007, Journal of clinical nursing.

[26]  L. Parish,et al.  Controversies about the decubitus ulcer. , 2004, Dermatologic clinics.

[27]  M G Kemp,et al.  Predicting the risk of pressure ulcers in critically ill patients. , 1999, American journal of critical care : an official publication, American Association of Critical-Care Nurses.

[28]  Laurent Audigé,et al.  How reliable are reliability studies of fracture classifications?A systematic review of their methodologies , 2004, Acta orthopaedica Scandinavica.

[29]  J. Verdú.  Can a decision tree help nurses to grade and treat pressure ulcers? , 2003, Journal of wound care.

[30]  Michael Clark,et al.  Statement of the European Pressure Ulcer Advisory Panel--pressure ulcer classification: differentiation between pressure ulcers and moisture lesions. , 2005, Journal of wound, ostomy, and continence nursing : official publication of The Wound, Ostomy and Continence Nurses Society.

[31]  R. D. de Bie,et al.  A 4-cm thermoactive viscoelastic foam pad on the operating room table to prevent pressure ulcer during cardiac surgery. , 2006, Journal of clinical nursing.

[32]  H. D. de Vet,et al.  Inter-observer variation in the assessment of skin ulceration. , 1996, Journal of wound care.

[33]  R. Halfens,et al.  Relevance of the diagnosis 'stage 1 pressure ulcer': an empirical study of the clinical course of stage 1 ulcers in acute care and long-term care hospital populations. , 2008, Journal of clinical nursing.

[34]  N. Bergstrom,et al.  Predictive validity of the Braden Scale for pressure sore risk in a nursing home population. , 1994, Research in nursing & health.

[35]  M. Clark,et al.  Pressure ulcer prevalence in Europe: a pilot study. , 2007, Journal of evaluation in clinical practice.

[36]  G. Pedley.  Comparison of pressure ulcer grading scales: a study of clinical utility and inter-rater reliability. , 2004, International journal of nursing studies.

[37]  J. Stausberg,et al.  Reliability and validity of pressure ulcer diagnosis and grading: an image-based survey. , 2007, International journal of nursing studies.

[38]  A. Sharp.  Pressure ulcer grading tools: how reliable are they? , 2004, Journal of wound care.

[39]  S. Compton,et al.  Nursing research. Principles and methods: 7th edition , 2005 .

[40]  C. Calianno.  Pressure ulcers in acute care: a quality issue. , 2007, Nursing management.

[41]  L. Russell.  Pressure ulcer classification: defining early skin damage. , 2002, British journal of nursing.

[42]  D. Streiner,et al.  Health measurement scales , 2008 .

[43]  F. Healey.  Classification of pressure sores: 2. , 1996, British journal of nursing.

[44]  L. Gunningberg.  EPUAP Pressure Ulcer Prevalence Survey in Sweden: A Two‐Year Follow‐Up of Quality Indicators , 2006, Journal of wound, ostomy, and continence nursing : official publication of The Wound, Ostomy and Continence Nurses Society.

[45]  B. Tran,et al.  The Use of Digital Images in Evaluating Homecare Nurses' Knowledge of Wound Assessment , 2005, Journal of wound, ostomy, and continence nursing : official publication of The Wound, Ostomy and Continence Nurses Society.

[46]  C L Gawron,et al.  Risk factors for and prevalence of pressure ulcers among hospitalized patients. , 1994, Journal of wound, ostomy, and continence nursing : official publication of The Wound, Ostomy and Continence Nurses Society.

[47]  W. Willett,et al.  Misinterpretation and misuse of the kappa statistic. , 1987, American journal of epidemiology.

[48]  E. Buskens,et al.  The prevalence and incidence of pressure ulcers in hospitalised patients in the Netherlands: a prospective inception cohort study. , 2007, International journal of nursing studies.

[49]  A hierarchical approach to inferences concerning interobserver agreement for multinomial data. , 1997, Statistics in medicine.

[50]  N. Cullum,et al.  Incidence, Prevalence, and Classification , 1997 .

[51]  Art Noda,et al.  Kappa coefficients in medical research , 2002, Statistics in medicine.

[52]  D. De Bacquer,et al.  The reliability of two observation methods of nonblanchable erythema, Grade 1 pressure ulcer. , 2006, Applied nursing research : ANR.

[53]  M. Shoukri,et al.  Measures of Interobserver Agreement , 2003 .

[54]  N. Graves,et al.  Modeling the economic losses from pressure ulcers among hospitalized patients in Australia , 2005, Wound repair and regeneration : official publication of the Wound Healing Society [and] the European Tissue Repair Society.

[55]  H. Kraemer.  Ramifications of a population model forκ as a coefficient of reliability , 1979 .

[56]  Lisette Schoonhoven,et al.  Inter-rater reliability of the EPUAP pressure ulcer classification system using photographs. , 2004, Journal of clinical nursing.

[57]  H. Wharrad,et al.  Interpretation of pressure-sore prevalence. , 1994, Journal of advanced nursing.

[58]  B. Pollock,et al.  Interrater reliability in clinical trials of depressive disorders. , 2002, The American journal of psychiatry.

[59]  D Norton,et al.  Calculating the risk: reflections on the Norton Scale. , 1989, Decubitus.

[60]  Hon Keung Tony Ng,et al.  Statistical Methods in Epidemiology , 2011, International Encyclopedia of Statistical Science.

[61]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[62]  R. Allman,et al.  Pressure ulcer risk factors among hospitalized patients with activity limitation. , 1995, JAMA.

[63]  Enid Kwong,et al.  Predicting pressure ulcer risk with the modified Braden, Braden, and Norton scales in acute care hospitals in Mainland China. , 2005, Applied nursing research : ANR.

[64]  P. Shrout.  Measurement reliability and agreement in psychiatry , 1998, Statistical methods in medical research.

[65]  R. Halfens,et al.  The development of a national registration form to measure the prevalence of pressure ulcers in The Netherlands. , 1999, Ostomy/wound management.

[66]  Lisette Schoonhoven,et al.  Incidence of pressure ulcers due to surgery. , 2002, Journal of clinical nursing.

[67]  B. Gajewski,et al.  Reliability Testing of the National Database of Nursing Quality Indicators Pressure Ulcer Indicator , 2006, Journal of nursing care quality.

[68]  F. Healey.  The Reliability and Utility of Pressure Sore Grading Scales , 1995 .

[69]  L. Russell,et al.  How accurate are pressure ulcer grades? An image-based survey of nurse performance. , 2001, Journal of tissue viability.

[70]  D. Myny,et al.  Reliability of the European Pressure Ulcer Advisory Panel classification system. , 2006, Journal of advanced nursing.

[71]  B. Ferrell,et al.  The Sessing Scale for Assessment of Pressure Ulcer Healing , 1995, Journal of the American Geriatrics Society.

[72]  R. Halfens,et al.  Pressure ulcer risk assessment immediately after cardiac surgery--does it make a difference? A comparison of three pressure ulcer risk assessment instruments within a cardiac surgery population. , 2007, Nursing in critical care.

[73]  R. Halfens,et al.  Prevalence of pressure ulcers in Germany. , 2005, Journal of clinical nursing.

[74]  V. Banks.  The classification of pressure sores. , 1998, Journal of wound care.

[75]  S. Mason,et al.  A sequential randomised controlled trial comparing a dry visco-elastic polymer pad and standard operating table mattress in the prevention of post-operative pressure sores. , 1998, International journal of nursing studies.

[76]  N. Bergstrom,et al.  Predicting pressure ulcer risk: a multisite study of the predictive validity of the Braden Scale. , 1998, Nursing research.

[77]  A. Rigby,et al.  Statistical methods in epidemiology. v. Towards an understanding of the kappa coefficient , 2000, Disability and rehabilitation.

[78]  Tom Defloor,et al.  Effectiveness of turning with unequal time intervals on the incidence of pressure ulcer lesions. , 2007, Journal of advanced nursing.

[79]  N. Stotts,et al.  Predicting Pressure Ulcer Risk , 2007 .

[80]  N. Bergstrom,et al.  Multi‐site Study of Incidence of Pressure Ulcers and the Relationship Between Risk Level, Demographic Characteristics, Diagnoses, and Prescription of Preventive Interventions , 1996, Journal of the American Geriatrics Society.

[81]  Pressure ulcers prevalence, cost and risk assessment: consensus development conference statement--The National Pressure Ulcer Advisory Panel. , 1989, Decubitus.

[82]  L. Dittert,et al.  Alprazolam Pharmacokinetics in Alcoholic Liver Disease , 1984, Journal of clinical pharmacology.

[83]  Jane Nixon,et al.  Reliability of pressure ulcer classification and diagnosis. , 2005, Journal of advanced nursing.

[84]  D. Hall,et al.  Pressure sores: a policy for prevention. , 1986, Nursing times.

[85]  J. Reid,et al.  Classification of pressure sore severity. , 1994, Nursing times.

[86]  S. Briggs.  How accurate are RGNs in grading pressure ulcers? , 2006, British journal of nursing.

[87]  A. Hrõbjartsson,et al.  Training improves agreement among doctors using the Neer system for proximal humeral fractures in a systematic review. , 2008, Journal of clinical epidemiology.

[88]  Tom Defloor,et al.  Effectiveness of an alternating pressure air mattress for the prevention of pressure ulcers. , 2005, Age and ageing.