Competency assessment models.

This article describes characteristics of alternative assessment models deployed in the measurement of professional competencies across the professional life span based on the work of the American Psychological Association Task Force on the Assessment of Competence in Professional Psychology. Assessments of knowledge, decision making, performance and personal attributes, as well as integrated practice-based skills and tasks are described and compared on the basis of their validity, feasibility and practicality, fidelity, and relevance at difference stages of professional development. It is acknowledged that no single assessment can evaluate all competencies and that assessments can be combined in complementary ways. Assessments deployed in the nursing, dental, and medical professions are reviewed and contrasted with current practices in psychology. At the licensure level, differences in the assessments deployed among the 4 healthcare professions are described, and their candidate fees and number of candidates assessed annually are documented. Ideas for developing new assessments in psychology are discussed on the basis of the needs and financial resources available to psychology and the experiences of other healthcare professions.

[1]  D W Chambers,et al.  A primer on competency-based evaluation. , 1997, Journal of dental education.

[2]  C. Fletcher,et al.  Assessing self‐awareness: some issues and methods , 2003 .

[3]  G. Norman,et al.  The Ability of the Multiple Mini-Interview to Predict Preclerkship Performance in Medical School , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[4]  K. Eva,et al.  An admissions OSCE: the multiple mini‐interview , 2004, Medical education.

[5]  Paul D. Nelson,et al.  Guiding principles and recommendations for the assessment of competence. , 2007 .

[6]  Alija Kulenović,et al.  Standards for Educational and Psychological Testing , 1999 .

[7]  A. Dugoni,et al.  The case against one-shot testing for initial dental licensure. , 2004, Journal of the California Dental Association.

[8]  Catherine Welch Item and Prompt Development in Performance Testing. , 2006 .

[9]  C. Carraccio,et al.  The objective structured clinical examination: a step in the direction of competency-based evaluation. , 2000, Archives of pediatrics & adolescent medicine.

[10]  John Stephenson,et al.  Capability and quality in higher education , 1998 .

[11]  Jeffrey K. Smith Reconsidering Reliability in Classroom Assessment and Grading , 2005 .

[12]  R. Frankel,et al.  Assessing Competence in Communication and Interpersonal Skills: The Kalamazoo II Report , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[13]  L. Rehm,et al.  The Examination for Professional Practice in Psychology. , 2006 .

[14]  Jill Burstein,et al.  Automated Essay Scoring : A Cross-disciplinary Perspective , 2003 .

[15]  Steven M. Downing,et al.  Handbook of test development , 2006 .

[16]  Nathan L. Linsk,et al.  Learning to Care , 1997 .

[17]  M J Bebeau,et al.  Measuring dental students' ethical sensitivity. , 1985, Journal of dental education.

[18]  H. Barrows An overview of the uses of standardized patients for teaching and evaluating clinical skills. AAMC , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[19]  Vicki Langendyk,et al.  Not knowing that they do not know: self‐assessment accuracy of third‐year medical students , 2006, Medical education.

[20]  J. Colliver,et al.  The Effect of Examinee and Patient Ethnicity in Clinical-Skills Assessment with Standardized Patients , 2001, Advances in health sciences education : theory and practice.

[21]  S. J. Lopez,et al.  Competency-Based Education and Training in Psychology: A Primer , 2000 .

[22]  T. Hummel,et al.  CLIENT 1: A Computer Simulation for Use in Counselor Education and Research , 1984 .

[23]  Robert E. Wood,et al.  Self- versus others' ratings as predictors of assessment center ratings: Validation evidence for 360-degree feedback programs. , 2002 .

[24]  B. Bridgeman,et al.  Success in college for students with discrepancies between performance on multiple-choice and essay tests. , 1996 .

[25]  Todd J. Maurer,et al.  Predictors of attitudes toward a 360‐degree feedback system and involvement in post‐feedback management development activity , 2002 .

[26]  J. DeVries,et al.  Evaluation of clinical competence: the gap between expectation and performance. , 1996, Pediatrics.

[27]  Paul D. Nelson,et al.  Challenges to the assessment of competence and competencies. , 2007 .

[28]  Anne F. Marrelli,et al.  Strategies for Developing Competency Models , 2005, Administration and Policy in Mental Health and Mental Health Services Research.

[29]  W. Shelton,et al.  Lost virtue : professional character development in medical education , 2006 .

[30]  P. Bashook Best practices for assessing competence and performance of the behavioral Health workforce , 2005, Administration and Policy in Mental Health and Mental Health Services Research.

[31]  T. Haladyna Developing and Validating Multiple-Choice Test Items , 1994 .

[32]  Paul D. Nelson,et al.  The Competency Movement Within Psychology: An Historical Perspective , 2007 .

[33]  Paul D. Nelson,et al.  A Cube Model for Competency Development: Implications for Psychology Educators and Regulators , 2005 .

[34]  P. Nelson,et al.  Competencies conference: future directions in education and credentialing in professional psychology. , 2004, Journal of clinical psychology.

[35]  P. Moss Reconceptualizing Validity for Classroom Assessment , 2005 .

[36]  E. Hundert,et al.  Defining and assessing professional competence. , 2002, JAMA.

[37]  David Baume,et al.  What is happening when we assess, and how can we use our understanding of this to improve assessment? , 2004 .

[38]  T. Hummel,et al.  Client 1: A Computer Program Which Simulates Client Behavior in an Initial Interview. , 1975 .

[39]  C. Manifold,et al.  360-degree feedback: possibilities for assessment of the ACGME core competencies for emergency medicine residents. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[40]  Susan M. Brookhart,et al.  Developing Measurement Theory for Classroom Assessment Purposes and Uses , 2005 .

[41]  Assessing Critical Thinking Using a Talk-Aloud Protocol , 2007 .

[42]  G. Larkin,et al.  Defining and evaluating professionalism: a core competency for graduate emergency medicine education. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[43]  A. Barsky,et al.  Evaluating Skill Acquisition in Motivational Interviewing: The Development of an Instrument to Measure Practice Skills , 2001, Journal of drug education.

[44]  Geoffrey R. Norman,et al.  Performance-Based Assessment: Lessons From the Health Professions , 1995 .

[45]  J. Colliver,et al.  Relationship between clinical competence and interpersonal and communication skills in standardized-patient assessment. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[46]  Mary Brabeck,et al.  Increasing Ethical Sensitivity to Racial and Gender Intolerance in Schools: Development of the Racial Ethical Sensitivity Test , 2000 .

[47]  K. Eva Teamwork during education: the whole is not always greater than the sum of the parts , 2002, Medical education.

[48]  P. Nelson Striving for competence in the assessment of competence: Psychology's professional education and credentialing journey of public accountability. , 2007 .

[49]  Sarah W. Fraser,et al.  Coping with complexity: educating for capability , 2001, BMJ : British Medical Journal.

[50]  Geoff Norman,et al.  Innovative Simulations for Assessing Professional Competence: From Paper and Pencil to Virtual Reality , 2000 .

[51]  M. D. Christiansen,et al.  Fostering a culture shift : Assessment of competence in the education and careers of professional psychologists , 2005 .