Development and Validation of the Cultural Competence of Program Evaluators (CCPE) Self-Report Scale

No self-report measure of cultural competence currently exists in program evaluation. Adapting items from cultural competence measures in fields such as counseling and nursing, the researchers developed the Cultural Competence of Program Evaluators (CCPE) self-report scale. The goals of this study were to validate the CCPE and to assess differences in level of cultural competence among program evaluators based on various demographic variables. The sample consisted of 174 evaluators. Principal components analyses revealed three factors of the CCPE: cultural knowledge, cultural skills, and cultural awareness. The overall alpha of the CCPE was .88, and convergent validity was established via significant positive correlations between the CCPE and the Multicultural Counseling Inventory (MCI). Additionally, individuals who had received cultural competence training scored significantly higher on the CCPE, and receipt of cultural competence training was a significant predictor of scores on the CCPE.

[1]  N. Lackey,et al.  Making Sense of Factor Analysis , 2003 .

[2]  Robert W. Covert,et al.  Designing and Constructing Instruments for Social Research and Evaluation , 2007 .

[3]  K. Kirkhart.  1994 Conference Theme: Evaluation and Social Justice Seeking Multicultural Validity: A Postcard from the Road , 1995 .

[4]  J. Campinha-Bacote.  The Process of Cultural Competence in the Delivery of Healthcare Services: A Model of Care , 2002, Journal of transcultural nursing : official journal of the Transcultural Nursing Society.

[5]  N. Lackey,et al.  Making Sense of Factor Analysis: The Use of Factor Analysis for Instrument Development in Health Care Research , 2003 .

[6]  Gargi Roysircar,et al.  Cultural Self-Awareness Assessment: Practice Examples From Psychology Training , 2004 .

[7]  James L. Mason.  Cultural Competence Self-Assessment Questionnaire: A Manual for Users. , 1995 .

[8]  D. Wear.  Insurgent Multiculturalism: Rethinking How and Why We Teach Culture in Medical Education , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[9]  J. Tschann,et al.  A violence-prevention and evaluation project with ethnically diverse populations. , 2001, American journal of preventive medicine.

[10]  Joy Frechtling Westat.  The 2002 user friendly handbook for project evaluation. , 2002 .

[11]  Karen Eileen Kirkhart,et al.  Seeking Multicultural Validity: A Postcard from the Road. , 1995 .

[12]  Rodney K. Hopson,et al.  Cultural competence in evaluation: An overview , 2004 .

[13]  Daniel L. Howard.  Culturally competent treatment of African American clients among a national sample of outpatient substance abuse treatment units. , 2003, Journal of substance abuse treatment.

[14]  S. Sue,et al.  Methodological issues in assessment research with ethnic minorities. , 1995 .

[15]  Gerunda Hughes,et al.  The 2002 User Friendly Handbook for Project Evaluation , 2002 .

[16]  A. Greene,et al.  Multicultural competence: Criteria and case examples. , 2000 .

[17]  Hazel Symonette.  Walking pathways toward becoming a culturally competent evaluator: Boundaries, borderlands, and border crossings , 2004 .

[18]  S. Wise,et al.  Development of the Multicultural Counseling Inventory: A self-report measure of multicultural competencies. , 1994 .

[19]  J. Greene.  Evaluation as Advocacy , 1997 .

[20]  B. Beagan.  Teaching Social and Cultural Awareness to Medical Students: “It's All Very Nice to Talk about It in Theory, But Ultimately It Makes No Difference” , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[21]  J. Yost,et al.  Measuring Cultural Awareness of Nursing Students , 2008, Journal of transcultural nursing : official journal of the Transcultural Nursing Society.

[22]  R. Carter.  Becoming Racially and Culturally Competent: The Racial‐Cultural Counseling Laboratory , 2003 .

[23]  Carol T. Kulik,et al.  Assessing Instructor Cultural Competence in the Classroom: An Instrument and a Development Process , 2002 .

[24]  Amy L. Reynolds,et al.  Student Affairs Core Competencies: Integrating Multicultural Awareness, Knowledge, and Skills. , 1997 .

[25]  R. Heck,et al.  Evaluating the Impact of Multicultural Counseling Training , 1991 .

[26]  J. Prochaska,et al.  Contemporary psychotherapists: A national survey of characteristics, practices, orientations, and attitudes. , 1983 .

[27]  C. Leppa,et al.  Beyond cultural competence: teaching about race, gender, class, and sexual orientation. , 2001, The Journal of nursing education.

[28]  D. W. Sue,et al.  The diversification of psychology: a multicultural revolution. , 1999, The American psychologist.

[29]  Denice Ward Hood,et al.  Feminist evaluation and the inclusion of difference , 2002 .

[30]  M. A. Scheirer,et al.  Guiding Principles for Evaluators , 1995 .

[31]  E. Mendias,et al.  Assessing culturally competent scholarship. , 2001, Journal of professional nursing : official journal of the American Association of Colleges of Nursing.

[32]  Anna R. McPhatter,et al.  Beyond the rhetoric: strategies for implementing culturally effective practice with children, families, and communities. , 2003, Child welfare.

[33]  J. Betancourt.  Cross‐cultural Medical Education: Conceptual Approaches and Frameworks for Evaluation , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[34]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[35]  D. Doutrich,et al.  Education and Practice: Dynamic Partners for Improving Cultural Competence in Public Health , 2004, Family & community health.

[36]  Viola G. Benavente.  Cultural and linguistic competency assessment , 2004 .

[37]  H. Hops,et al.  Cultural sensitivity: Problems and solutions in applied and preventive intervention , 1999 .

[38]  J. Bourjolly,et al.  Evaluating cultural competence among behavioral health professionals. , 2005, Psychiatric rehabilitation journal.

[39]  A. Abernethy.  Increasing the Cultural Proficiency of Clinical Managers. , 2005 .

[40]  D. W. Sue,et al.  Multicultural Counseling Competencies and Standards: A Call to the Profession , 1992 .

[41]  J. Prochaska,et al.  Transtheoretical therapy: Toward a more integrative model of change. , 1982 .

[42]  T. Johnson.  A VALIDATION OF THE CROWNE-MARLOWE SOCIAL DESIRABILITY SCALE , 2002 .

[43]  Leroy White,et al.  Working with Heterogeneity: A Pluralist Strategy for Evaluation , 1997 .