Assessing competence to practise in nursing: a review of the literature

Recent reforms of nursing education have led to calls for assessment of clinical performance to contribute to academic qualifications that incorporate professional awards. Questions then follow concerning the psychometric quality of methods available for assessing competence and performance and the ability of the methods to distinguish between different levels of practice. The purpose of this review of the literature is to analyse methods of assessing competence to practise in nursing and draw conclusions on their reliability and validity. The methods reviewed include questionnaire rating scales, ratings by observation, criterion-referenced rating scales, simulations including the objective structured clinical examination (OSCE), Benner's model of skill acquisition, reflection in and on practice, self-assessment and multi-method approaches. Methodological challenges to competence assessment are raised. Findings of the review are as follows. Questionnaire rating scales used to assess competence in nursing have not been rigorously tested for reliability and validity. The methodological limitations of observation can be overcome with use of criterion-referenced scales or simulations such as the OSCE or its variations, as has been found in research on competence assessment in medicine. The Bart's Nursing OSCE, designed for the end of the common foundation programme of the nursing diploma course, has promise because it provides a close simulation to real life and is grounded in an interpretive approach to skill acquisition. Reflection on practice using portfolios, learning contracts and self-assessment is valid if based on rigorous analysis of critical incidents rather than simple description. Reflective approaches have the advantage of being located in real-life settings and can integrate theory with practice but they need skilled collaboration between teachers, employers and practitioners. The conclusion is that a multimethod approach enhances validity and ensures comprehensive assessment of the complex repertoire of skills required of students in nursing.

[1]  P. Ashworth The scope of professional practice. , 1992, Intensive & critical care nursing.

[2]  A. While The problem of clinical evaluation--a review. , 1991, Nurse education today.

[3]  A. O'neill,et al.  Objectively assessing nursing practices: a curricular development. , 1996, Nurse education today.

[4]  Acs Task Force on Professionalism Code of professional conduct. , 2003 .

[5]  R. McGraw,et al.  Clinical skills training: developing objective assessment instruments , 1997, Medical education.

[6]  K. Bramble Nurse practitioner education: enhancing performance through the use of the Objective Structured Clinical Assessment. , 1994, The Journal of nursing education.

[7]  K. Gerrish,et al.  'Levels' of attainment in nursing practice: reality or illusion? , 1999, Journal of advanced nursing.

[8]  J. Roberts,et al.  Testing the OSCE: a reliable measurement of clinical nursing skills. , 1990, The Canadian journal of nursing research = Revue canadienne de recherche en sciences infirmieres.

[9]  K. Bondy,et al.  Clinical evaluation of student performance: the effects of criteria on accuracy and reliability. , 1984, Research in nursing & health.

[10]  D. Dupras,et al.  Use of an objective structured clinical examination to determine clinical competence , 1995, Academic medicine : journal of the Association of American Medical Colleges.

[11]  F. Fothergill-Bourbonnais,et al.  Using the OSCE to measure clinical skills performance in nursing. , 1988, Journal of advanced nursing.

[12]  C. Tanner,et al.  HOW EXPERT NURSES USE INTUITION , 1987 .

[13]  A. McFarlane,et al.  A factor analytic study of clinical competence in undergraduate psychiatry , 1989, Medical education.

[14]  B. Edlund,et al.  Evaluating clinical decision-making skills of nurse practitioner students. , 1999, Clinical excellence for nurse practitioners : the international journal of NPACE.

[15]  M. Polanyi Chapter 7 – The Tacit Dimension , 1997 .

[16]  P. Morrison,et al.  Problems of competence-based nurse education. , 1991, Nurse education today.

[17]  S. Dunn,et al.  The development of competency standards for specialist critical care nurses. , 2000, Journal of advanced nursing.

[18]  R. Harden,et al.  Assessment of clinical competence using objective structured examination. , 1975, British medical journal.

[19]  Michael Eraut,et al.  Concepts of competence , 1998 .

[20]  N. Steen,et al.  Testing a rating scale of video-taped consultations to assess performance of trainee nurse practitioners in general practice. , 1999, Journal of advanced nursing.

[21]  C. P. Goodman,et al.  The Tacit Dimension , 2003 .

[22]  D. Ciliska,et al.  The objective structured clinical examination: an alternative approach to assessing student clinical performance. , 1987, The Journal of nursing education.

[23]  A comparison of assessor and self dimension ratings in an advanced management assessment centre , 1998 .

[24]  E. Girot Assessment of competence in clinical practice--a review of the literature. , 1993, Nurse education today.

[25]  A. While,et al.  Simulation: current status in nurse education. , 1992, Nurse education today.

[26]  K. Savik,et al.  The clinical evaluation tool: a measure of the quality of clinical performance of baccalaureate nursing students. , 1994, The Journal of nursing education.

[27]  A. While,et al.  The measurement of nurse performance and its differentiation by course of preparation. , 1994, Journal of advanced nursing.

[28]  SLATER NURSING COMPETENCIES RATING SCALE , 1975 .

[29]  M. Mentkowski,et al.  Does the baccalaureate make a difference?: Differentiating nurse performance by education and experience. , 1986, The Journal of nursing education.

[30]  P. Schwirian Evaluating the Performance of Nurses: A Multidimensional Approach , 1978, Nursing research.

[31]  N. Crawford,et al.  Nursing student novice to expert--Benner's research applied to education. , 1989, The Journal of nursing education.

[32]  Greg Ryan,et al.  Assessing the Practicum , 1996 .

[33]  P. Benner,et al.  Clinical judgment: how expert nurses use intuition. , 1987, The American journal of nursing.

[34]  A. While,et al.  Operationalisation of an observation instrument to explore nurse performance. , 1996, International journal of nursing studies.

[35]  C. Clifford Assessment of clinical practice and the role of the nurse teacher. , 1994, Nurse education today.

[36]  Assessment of practice in pre-registration nurse education and the development of a skills acquisition manual. , 1998, Nurse education today.

[37]  M. Hazelton,et al.  Assessing comprehensive nursing performance: the Objective Structural Clinical Assessment (OSCA). Part 1--Development of the assessment strategy. , 1991, Nurse education today.

[38]  David Arthur Rn Assessing nursing students' basic communication and interviewing skills: the development and testing of a rating scale , 1999 .

[39]  D Arthur,et al.  Assessing nursing students' basic communication and interviewing skills: the development and testing of a rating scale. , 1999, Journal of advanced nursing.

[40]  A. Woolley The long and tortured history of clinical evaluation. , 1977, Nursing outlook.

[41]  Assessment of an objective structured clinical examination (OSCE) for undergraduate students in accident and emergency medicine. , 1994, Journal of accident & emergency medicine.

[42]  I. Norman,et al.  Quality of nursing care perceived by patients and their nurses: an application of the critical incident technique. Part 2. , 1999, Journal of clinical nursing.

[43]  R. Elkan,et al.  Project 2000: a review of published research. , 1995, Journal of advanced nursing.

[44]  A. While Competence versus performance: which is more important? , 1994, Journal of advanced nursing.

[45]  G. R. Norman,et al.  Report card from McMaster: student evaluation at a problem-based medical school , 1995, The Lancet.

[46]  D. Matsell,et al.  Reliability and validity of the objective structured clinical examination in paediatrics , 1991, Medical education.

[47]  M. Hazelton,et al.  Assessing comprehensive nursing performance: the objective structured clinical assessment (OSCA). Part 2--Report of the evaluation project. , 1991, Nurse education today.

[48]  D. Kember,et al.  Assessing the level of student reflection from reflective journals. , 1995, Journal of advanced nursing.

[49]  A. While,et al.  An exploratory study of similarities and differences between senior students from different pre-registration nurse education courses. , 1998, Nurse education today.

[50]  D. Kolb Experiential Learning: Experience as the Source of Learning and Development , 1983 .

[51]  P. Aggleton,et al.  Developing a system for the continuous assessment of practical nursing skills. , 1987, Nurse education today.

[52]  J. Cox,et al.  An instrument for assessment of videotapes of general practitioners' performance. , 1993, BMJ.

[53]  J. Delisa,et al.  Development of an objective structured clinical examination (OSCE) for physical medicine and rehabilitation residents. , 1996, American journal of physical medicine & rehabilitation.

[54]  J. Wilson‐Barnett,et al.  Clinical support and the Project 2000 nursing student: factors influencing this process. , 1995, Journal of advanced nursing.

[55]  A. McFarlane,et al.  Assessment in undergraduate psychiatric education , 1986, Medical education.

[56]  R. J. Bogumil,et al.  The reflective practitioner: How professionals think in action , 1985, Proceedings of the IEEE.

[57]  D Osterweil,et al.  Objective structured clinical examination , 2001, BMJ.

[58]  J. Donoghue,et al.  An empirical analysis of a clinical assessment tool. , 1991, Nurse education today.

[59]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[60]  G. Norman,et al.  Pitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptability , 1991, Medical education.

[61]  N V Vu,et al.  Reliability and efficiency of components of clinical competence assessed with five performance‐based examinations using standardized patients , 1991, Medical education.

[62]  Shai Ben-David,et al.  On self-directed learning , 1995, COLT '95.

[63]  A. While,et al.  Measuring clinical nurse performance: development of the King's Nurse Performance Scale. , 1997, International journal of nursing studies.

[64]  S. Glen,et al.  Portfolios: an 'affective' assessment strategy? , 1992, Nurse education today.

[65]  V. Wood Clinical evaluation of student nurses: syllabus needs for nursing instructors. , 1986, Nurse education today.

[66]  R. Murphy,et al.  Towards an integrated model of competence in midwifery. , 1994, Midwifery.

[67]  R. Godfrey Undergraduate examinations—a continuing tyranny , 1995, The Lancet.

[68]  P. Morrison,et al.  The role of the external examiner in the assessment of clinical practice. , 1997, Nurse education today.

[69]  A. Bradshaw Defining 'competency' in nursing (Part I): A policy review. , 1997, Journal of clinical nursing.

[70]  Malcolm Shepherd Knowles,et al.  Using learning contracts : practical approaches to individualizing and structuring learning , 1986 .

[71]  K. Gerrish An evaluation of a portfolio as an assessment tool for teaching practice placements. , 1993, Nurse education today.

[72]  K. Wikblad,et al.  A summative evaluation of clinical competence: students' and nurses' perceptions of inpatients' individual physical and emotional needs. , 1999, Journal of advanced nursing.

[73]  N. Chambers Close encounters: the use of critical reflective analysis as an evaluation tool in teaching and learning. , 1999, Journal of advanced nursing.

[74]  V. Coates,et al.  Evaluation of tools to assess clinical competence. , 1992, Nurse education today.

[75]  S. Redfern,et al.  Quality of nursing care perceived by patients and their nurses: an application of the critical incident technique. Part 1. , 1999, Journal of clinical nursing.

[76]  M. Duke Clinical evaluation--difficulties experienced by sessional clinical teachers of nursing: a qualitative study. , 1996, Journal of advanced nursing.

[77]  M Nayer,et al.  An overview of the objective structured clinical examination. , 1993, Physiotherapy Canada. Physiotherapie Canada.

[78]  C. Bland,et al.  Comparing students' feedback about clinical instruction with their performances , 1991, Academic medicine : journal of the Association of American Medical Colleges.

[79]  P. Benner Issues in competency-based testing. , 1982, Nursing outlook.

[80]  Adèle Martin,et al.  The Objective Structured Clinical Examination as a Method of Occupational Therapy Student Evaluation , 1989 .

[81]  M. Jasper The portfolio workbook as a strategy for student-centred learning. , 1995, Nurse education today.

[82]  I. English,et al.  Intuition as a function of the expert nurse: a critique of Benner's novice to expert model. , 1993, Journal of advanced nursing.

[83]  F. Milligan,et al.  Defining and assessing competence: the distraction of outcomes and the importance of educational process. , 1998, Nurse education today.

[84]  V. Wood Evaluation of student nurse clinical performance--a continuing problem. , 1982, International nursing review.

[85]  J. Bligh,et al.  Recent developments in assessing medical students. , 1998, Postgraduate medical journal.

[86]  C. James,et al.  Reflective practice in nursing: issues and implications for nurse education. , 1994, Nurse education today.

[87]  P. Benner From novice to expert. , 1984, The American journal of nursing.

[88]  R. Squier The reliability and validity of rating scales in assessing the clinical progress of psychiatric nursing students. , 1981, International journal of nursing studies.

[89]  G. Norman,et al.  Pitfalls in the pursuit of objectivity: issues of reliability , 1991, Medical education.

[90]  D. Freeth,et al.  Assessment of clinical skills: a new approach to an old problem. , 1998, Nurse education today.

[91]  B. Carper Fundamental Patterns of Knowing in Nursing , 1978, ANS. Advances in nursing science.

[92]  C. Knight Evaluating a skills centre: the acquisition of psychomotor skills in nursing--a review of the literature. , 1998, Nurse education today.

[93]  K N Bondy,et al.  Criterion-referenced definitions for rating scales in clinical evaluation. , 1983, The Journal of nursing education.

[94]  L. Calman,et al.  The validity and reliability of methods to assess the competence to practise of pre-registration nursing and midwifery students. , 2002, International journal of nursing studies.