Development and validation of an inventory (Dundee Barometer of Institutional Professionalism) to measure the professionalism culture of medical schools in the UK

Background: Professionalism, in today’s context, is a determinant of fitness‐to‐practise of doctors. Many professional and governing bodies around the world have emphasised the need for educating medical students explicitly about professionalism. In fostering professionalism, the institutional culture plays a concealed but vital role. Although the institutional professionalism culture should be explored and understood there was no suitable measure for use in the context of UK undergraduate medical education. The aim of this project was to develop a valid, reliable and practical measure of institutional professionalism culture. Methods and results: The project was conducted in two phases. In the first phase, forty six attributes of professionalism were identified in a literature review. These attributes were surveyed among a nationally representative quota sample of 954 members of the UK general public. They identified 44 attributes as important. With a principal component analysis, three facets to professionalism were identified: the relationship of doctors with patients (clinicianship) and co‐workers (workmanship), and the behaviour of doctors in society (citizenship). By analysing the survey responses of 368 UK medical professionals using the Content Validity Index, 28 attributes were identified to represent each facet (clinicianship 10, workmanship 11, and citizenship 7). In the second phase, the 28 attributes were included in an online measure (Dundee Barometer of Institutional Professionalism) with a rating scale based on the Theory of Planned Behaviour (TPB), and field‐tested among the faculty and students of the Dundee

[1]  S. Javali,et al.  Health sciences students’ perception of the educational environment of KLE University, India as measured with the Dundee Ready Educational Environment Measure (DREEM) , 2015, Journal of Educational Evaluation for Health Professions.

[2]  C. Rees,et al.  “It’s just a clash of cultures”: emotional talk within medical students’ narratives of professionalism dilemmas , 2012, Advances in health sciences education : theory and practice.

[3]  J. P. Méndez,et al.  High Knowledge About Obesity and its Health Risks, with the Exception of Cancer, Among Mexican Individuals , 2012, Journal of Cancer Education.

[4]  S. Roff,et al.  Medical student rankings of proposed sanction for unprofessional behaviours relating to academic integrity: results from a Scottish medical school , 2012, Scottish medical journal.

[5]  A. Meade,et al.  Identifying careless responses in survey data. , 2012, Psychological methods.

[6]  F. Rapport,et al.  Patient-centered professionalism , 2012 .

[7]  M. Chandratilake,et al.  Cultural similarities and differences in medical professionalism: a multi‐region study , 2012, Medical education.

[8]  H. O’Sullivan,et al.  Integrating professionalism into the curriculum: AMEE Guide No. 61 , 2012, Medical teacher.

[9]  D. Bennett,et al.  A psychometric appraisal of the DREEM , 2012, BMC medical education.

[10]  D. K. Williams,et al.  Evidence for validity of a survey to measure the learning environment for professionalism , 2011, Medical teacher.

[11]  J. Whitney,et al.  Understanding pressure ulcer research and education needs: a comparison of the association for the advancement of wound care pressure ulcer guideline evidence levels and content validity scores. , 2011, Ostomy/wound management.

[12]  Renée Speyer,et al.  Reliability and validity of student peer assessment in medical education: A systematic review , 2011, Medical teacher.

[13]  T. David,et al.  Unprofessional behaviour in medical students: A questionnaire-based pilot study comparing perceptions of the public with medical students and doctors , 2011, Medical teacher.

[14]  S. Leinster,et al.  Cross-sectional evaluation of a longitudinal consultation skills course at a new UK medical school , 2011, BMC medical education.

[15]  M. Tavakol,et al.  Psychometric properties and confirmatory factor analysis of the Jefferson Scale of Physician Empathy , 2011, BMC medical education.

[16]  T. Fukui,et al.  Introducing the Professionalism Mini-Evaluation Exercise (P-MEX) in Japan: Results From a Multicenter, Cross-Sectional Study , 2011, Academic medicine : journal of the Association of American Medical Colleges.

[17]  L. Elit,et al.  Ethical issues encountered by medical students during international health electives , 2011, Medical education.

[18]  S. Jastaniah,et al.  Saudi Meds: A competence specification for Saudi medical graduates , 2011, Medical teacher.

[19]  C. Rees,et al.  Differences in medical students’ explicit discourses of professionalism: acting, representing, becoming , 2011, Medical education.

[20]  R. Cruess,et al.  Commentary: Professionalism, Unionization, and Physicians' Strikes , 2011, Academic medicine : journal of the Association of American Medical Colleges.

[21]  M. Young,et al.  Developing and piloting a form for student assessment of faculty professionalism , 2011, Advances in health sciences education : theory and practice.

[22]  B. Hodges,et al.  Assessment of professionalism: Recommendations from the Ottawa 2010 Conference , 2011, Medical teacher.

[23]  L. Lingard,et al.  ‘Is that normal?’ Pre‐clerkship students’ approaches to professional dilemmas , 2011, Medical education.

[24]  C. Rees,et al.  Medical students learning intimate examinations without valid consent: a multicentre study , 2011, Medical education.

[25]  S. Rosenthal,et al.  Humanism at Heart: Preserving Empathy in Third-Year Medical Students , 2011, Academic medicine : journal of the Association of American Medical Colleges.

[26]  S. Roff,et al.  Development of inventory for polyprofessionalism lapses at the proto-professional stage of health professions education together with recommended responses , 2011, Medical teacher.

[27]  M. Steiner,et al.  Professionalism Expectations Seen Through the Eyes of Resident Physicians and Patient Families , 2011, Pediatrics.

[28]  M. Tavakol,et al.  Empathy in UK Medical Students: Differences by Gender, Medical Year and Specialty Interest , 2011, Education for primary care : an official publication of the Association of Course Organisers, National Association of GP Tutors, World Organisation of Family Doctors.

[29]  J. Rethans,et al.  Combined formative and summative professional behaviour assessment approach in the bachelor phase of medical school: A Dutch perspective , 2010, Medical teacher.

[30]  S. Nalliah,et al.  Learning professionalism by role‐modelling , 2010, Medical education.

[31]  S. Lurie,et al.  Development of an Audit Method to Assess the Prevalence of the ACGME’s General Competencies in an Undergraduate Medical Education Curriculum , 2010, Teaching and learning in medicine.

[32]  D. Ander,et al.  A core competency-based objective structured clinical examination (OSCE) can predict future resident performance. , 2010, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[33]  C. Brazeau,et al.  Relationships Between Medical Student Burnout, Empathy, and Professionalism Climate , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[34]  Angela P. Wetzel,et al.  Measuring Medical Students' Orientation Toward Lifelong Learning: A Psychometric Evaluation , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[35]  R. Stansfield,et al.  Use of Simulated Electronic Mail (E-mail) to Assess Medical Student Knowledge, Professionalism, and Communication Skills , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[36]  Peter Dangerfield,et al.  Developing professionalism through the use of wikis: A study with first-year undergraduate medical students , 2010, Medical teacher.

[37]  J. Wardle,et al.  Ethnic disparities in knowledge of cancer screening programmes in the UK , 2010, Journal of medical screening.

[38]  W. Branch The road to professionalism: reflective practice and reflective learning. , 2010, Patient education and counseling.

[39]  S. Cohn,et al.  Medical Professionalism: Conflicting Values for Tomorrow's Doctors , 2010, Journal of General Internal Medicine.

[40]  P. Lambe,et al.  What are the most important non-academic attributes of good doctors? A Delphi survey of clinicians , 2010, Medical teacher.

[41]  A. Mirzazadeh,et al.  Ethical issues confronted by medical students during clinical rotations , 2010, Medical education.

[42]  P. Van Royen,et al.  Help, I’m losing patient‐centredness! Experiences of medical students and their teachers , 2010, Medical education.

[43]  Helen O'Sullivan,et al.  Facebook and the professional behaviours of undergraduate medical students , 2010, The clinical teacher.

[44]  A. Ballantyne,et al.  Towards a practical definition of professional behaviour , 2010, Journal of Medical Ethics.

[45]  J. McLachlan Measuring conscientiousness and professionalism in undergraduate medical students , 2010, The clinical teacher.

[46]  R. G. Cumming,et al.  Is probability sampling always better? A comparison of results from a quota and a probability sample survey. , 2010, Community health studies.

[47]  S. Campbell,et al.  Does GPs' self-perception of their professional role correspond to their social self-image? - A qualitative study from Germany , 2010, BMC family practice.

[48]  M. Şehiralti,et al.  Attributes of a good physician: what are the opinions of first-year medical students? , 2010, Journal of Medical Ethics.

[49]  S. Leinster,et al.  Identifying professional characteristics of the ideal medical doctor: The laddering technique , 2010, Medical teacher.

[50]  T. Inui,et al.  Medical Students' Professionalism Narratives: A Window on the Informal and Hidden Curriculum , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[51]  Y. Steinert,et al.  Teaching professionalism across cultural and national borders: Lessons learned from an AMEE workshop , 2010, Medical teacher.

[52]  L. Monrouxe Identity, identification and medical education: why should we care? , 2010, Medical education.

[53]  J. Quaintance,et al.  What Students Learn About Professionalism From Faculty Stories: An “Appreciative Inquiry” Approach , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[54]  R. Epstein,et al.  Impact of Peer Assessment on the Professional Development of Medical Students: A Qualitative Study , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[55]  E. Petrusa,et al.  Medical Students' Experiences of Moral Distress: Development of a Web-Based Survey , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[56]  Margaret V. Lloyd,et al.  Medical ethics and law for doctors of tomorrow: the 1998 Consensus Statement updated , 2009, Journal of Medical Ethics.

[57]  C. V. D. van der Vleuten,et al.  Approaches to professional behaviour assessment: tools in the professionalism toolbox. , 2009, European journal of internal medicine.

[58]  H. O’Sullivan,et al.  Graduates from a traditional medical curriculum evaluate the effectiveness of their medical curriculum through interviews , 2009, BMC Medical Education.

[59]  G. Finn,et al.  Peer estimation of lack of professionalism correlates with low Conscientiousness Index scores , 2009, Medical education.

[60]  S. Leinster,et al.  How medical students demonstrate their professionalism when reflecting on experience , 2009, Medical education.

[61]  Jennifer A. Cowley,et al.  Subjective Response Differences between Visual Analogue, Ordinal and Hybrid Response Scales , 2009 .

[62]  Camille DiLullo,et al.  Clinical competencies and the basic sciences: An online case tutorial paradigm for delivery of integrated clinical and basic science content , 2009, Anatomical sciences education.

[63]  P. Mueller Incorporating professionalism into medical education: the Mayo Clinic experience. , 2009, The Keio journal of medicine.

[64]  S. Greysen,et al.  Online posting of unprofessional content by medical students. , 2009, JAMA.

[65]  Martin P Eccles,et al.  Response rates in postal surveys of healthcare professionals between 1996 and 2005: An observational study , 2009, BMC health services research.

[66]  Michael J. Vergare,et al.  The Devil is in the Third Year: A Longitudinal Study of Erosion of Empathy in Medical School , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[67]  F. Hafferty,et al.  A sociological framing of medicine’s modern‐day professionalism movement , 2009, Medical education.

[68]  C. Boelen,et al.  Social accountability and accreditation: a new frontier for educational institutions , 2009, Medical education.

[69]  Jerry M Maniate,et al.  Sociological interpretations of professionalism , 2009, Medical education.

[70]  C. Bryan,et al.  Building character: a model for reflective practice. , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[71]  M. Hojat,et al.  Measurement and Correlates of Physicians’ Lifelong Learning , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[72]  G. Finn,et al.  Exploring reflective 'critical incident' documentation of professionalism lapses in a medical undergraduate setting , 2009, BMC medical education.

[73]  C. V. D. van der Vleuten,et al.  General considerations regarding assessment of professional behaviour. , 2009, European journal of internal medicine.

[74]  C. Rees,et al.  The Construction of Patients' Involvement in Hospital Bedside Teaching Encounters , 2009, Qualitative health research.

[75]  R. N. Remen,et al.  Promise of Professionalism: Personal Mission Statements Among a National Cohort of Medical Students , 2009, The Annals of Family Medicine.

[76]  C. V. D. van der Vleuten,et al.  The concepts of professionalism and professional behaviour: conflicts in both definition and learning outcomes. , 2009, European journal of internal medicine.

[77]  M. Lypson,et al.  Beyond Cultural Competence: Critical Consciousness, Social Justice, and Multicultural Education , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[78]  M. Wenrich,et al.  Learning Professionalism: Perspectives of Preclinical Medical Students , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[79]  G. Regehr,et al.  From behaviours to attributions: further concerns regarding the evaluation of professionalism , 2009, Medical education.

[80]  P. Viviani,et al.  Measuring students' perceptions of the educational climate of the new curriculum at the Pontificia Universidad Católica de Chile: performance of the Spanish translation of the Dundee Ready Education Environment Measure (DREEM). , 2009, Education for health.

[81]  Tim J. Wilkinson,et al.  A Blueprint to Assess Professionalism: Results of a Systematic Review , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[82]  A. Berlin,et al.  Your life in their pocket: students' behaviors regarding confidential patient information. , 2009, Family medicine.

[83]  G. Makoul,et al.  Defining Professionalism From the Perspective of Patients, Physicians, and Nurses , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[84]  S. Deshpande A Study of Ethical Decision Making by Physicians and Nurses in Hospitals , 2009 .

[85]  Eszter Hargittai,et al.  An Update on Survey Measures of Web-Oriented Digital Literacy , 2009 .

[86]  S. Crandall,et al.  Assessment of matriculating medical students’ knowledge and attitudes towards professionalism , 2009, Medical teacher.

[87]  Win May,et al.  Shaping professionalism in pre-clinical medical students: Professionalism and the practice of medicine , 2009, Medical teacher.

[88]  M. Wiggins,et al.  Patient perceptions of professionalism: implications for residency education , 2009, Medical education.

[89]  B. Clauser,et al.  Assessment of medical professionalism: Who, what, when, where, how, and … why? , 2009, Medical teacher.

[90]  G. Halaas,et al.  Learning professionalism during the third year of medical school in a 9-month-clinical rotation in rural Minnesota , 2009, Medical teacher.

[91]  K. Aramesh,et al.  Measuring professionalism in residency training programs in Iran , 2009, Medical teacher.

[92]  James Carifio,et al.  Resolving the 50‐year debate around using and misusing Likert scales , 2008, Medical education.

[93]  R. Warrier,et al.  Early learner perceptions of the attributes of effective preceptors , 2008, Advances in health sciences education : theory and practice.

[94]  Vineet M. Arora,et al.  The YouTube Generation: Implications for Medical Professionalism , 2008, Perspectives in biology and medicine.

[95]  I. Grava-Gubins,et al.  Effects of various methodologic strategies: survey response rates among Canadian physicians and physicians-in-training. , 2008, Canadian family physician Medecin de famille canadien.

[96]  Melissa J. Margolis,et al.  Collecting Validity Evidence for an Assessment of Professionalism: Findings from Think-Aloud Interviews , 2008, Academic medicine : journal of the Association of American Medical Colleges.

[97]  D. Bhugra Professionalism and psychiatry: the profession speaks , 2008, Acta psychiatrica Scandinavica.

[98]  M. Couper,et al.  Do Incentives Exert Undue Influence on Survey Participation? Experimental Evidence , 2008, Journal of empirical research on human research ethics : JERHRE.

[99]  Judah L Goldberg Humanism or Professionalism? The White Coat Ceremony and Medical Education , 2008, Academic medicine : journal of the Association of American Medical Colleges.

[100]  Tse-Hua Shih,et al.  Comparing Response Rates from Web and Mail Surveys: A Meta-Analysis , 2008 .

[101]  Carol Hustedde,et al.  The theory of planned behaviour in medical education: a model for integrating professionalism training , 2008, Medical education.

[102]  Brooks C. Holtom,et al.  Survey response rate levels and trends in organizational research , 2008 .

[103]  A. Buyx,et al.  Challenges of educating for medical professionalism: who should step up to the line? , 2008, Medical education.

[104]  N. Ameh,et al.  Computer knowledge amongst clinical year medical students in a resource poor setting. , 2008, African health sciences.

[105]  E. S. Casper Using implementation intentions to teach practitioners: changing practice behaviors via continuing education. , 2008, Psychiatric services.

[106]  Angie Bone,et al.  Body piercing in England: a survey of piercing at sites other than earlobe , 2008, BMJ : British Medical Journal.

[107]  José Muñiz,et al.  Effect of the Number of Response Categories on the Reliability and Validity of Rating Scales , 2008 .

[108]  Y. Steinert,et al.  Role modelling—making the most of a powerful teaching strategy , 2008, BMJ : British Medical Journal.

[109]  Brian A. Nosek,et al.  Distinguishing automatic and controlled components of attitudes from direct and indirect measurement methods. , 2008, Journal of experimental social psychology.

[110]  Anthony J. O’Sullivan,et al.  Assessment of professionalism in undergraduate medical students , 2008, Medical teacher.

[111]  J. Goldie Integrating professionalism teaching into undergraduate medical education in the UK setting , 2008, Medical teacher.

[112]  Jordan J. Cohen Viewpoint: linking professionalism to humanism: what it means, why it matters. , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[113]  M. Verkerk,et al.  Reflective professionalism: interpreting CanMEDS’ “professionalism” , 2007, Journal of Medical Ethics.

[114]  G. Regehr,et al.  Reasoning When It Counts: Students’ Rationales for Action on a Professionalism Exam , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[115]  Carmen R. Wilson VanVoorhis,et al.  Understanding Power and Rules of Thumb for Determining Sample Sizes , 2007 .

[116]  T. Roberts,et al.  A systematic review of studies assessing and facilitating attitudes towards professionalism in medicine , 2007, Medical education.

[117]  E. Austin,et al.  A preliminary study of empathy, emotional intelligence and examination performance in MBChB students , 2007, Medical education.

[118]  S. Kalishman,et al.  Can There Be a Single System for Peer Assessment of Professionalism among Medical Students? A Multi-Institutional Study , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[119]  J. Goldie,et al.  Teaching professionalism in the early years of a medical curriculum: a qualitative study , 2007, Medical education.

[120]  K. Parakh Assessment in medical education. , 2007, The New England journal of medicine.

[121]  H. Sox The ethical foundations of professionalism: a sociologic history. , 2007, Chest.

[122]  G. Maudsley,et al.  Junior medical students' notions of a ‘good doctor’ and related expectations: a mixed methods study , 2007, Medical education.

[123]  Peggy Wagner,et al.  Defining medical professionalism: a qualitative study , 2007, Medical education.

[124]  J. Frank,et al.  The CanMEDS initiative: implementing an outcomes-based framework of physician competencies , 2007, Medical teacher.

[125]  S. Carmichael,et al.  The use of a video interview to enhance gross anatomy students’ understanding of professionalism , 2007, Medical teacher.

[126]  G. Merenstein,et al.  Addressing the hidden curriculum: Understanding educator professionalism , 2007, Medical teacher.

[127]  S. Melnick,et al.  Professionalism in medical education: The development and validation of a survey instrument to assess attitudes toward professionalism , 2007, Medical teacher.

[128]  P. Harasym,et al.  Students’ perception on medical professionalism: the psychometric perspective , 2007, Medical teacher.

[129]  J. Shumway,et al.  Assessing Medical Student Professionalism: An Analysis of a Peer Assessment , 2006, Medical education online.

[130]  A. Stephenson,et al.  The teaching of professional attitudes within UK medical schools: reported difficulties and good practice , 2006, Medical education.

[131]  Barbara J. Kennedy,et al.  medical school selection. Medical school selection: screening for dysfunctional tendencies , 2006, Medical education.

[132]  Shiphra Ginsburg,et al.  The Professionalism Mini-Evaluation Exercise: A Preliminary Investigation , 2006, Academic medicine : journal of the Association of American Medical Colleges.

[133]  N. Klazinga,et al.  Genesis of the professional−patient relationship in early practical experience: qualitative and quantitative study , 2006, Medical education.

[134]  T. Roberts,et al.  Perceptions of professionalism in medicine: a qualitative study , 2006, Medical education.

[135]  K. Szauter,et al.  Medical Student Professionalism: Are We Measuring the Right Behaviors? A Comparison of Professional Lapses by Students and Physicians , 2006, Academic medicine : journal of the Association of American Medical Colleges.

[136]  Cheryl Tatano Beck,et al.  The content validity index: are you sure you know what's being reported? Critique and recommendations. , 2006, Research in nursing & health.

[137]  Peter Tyrer,et al.  Rating Scales, Scales of Measurement, Issues of Reliability: Resolving Some Critical Issues for Clinicians and Researchers , 2006, The Journal of nervous and mental disease.

[138]  A. Scherpbier,et al.  Are some of the challenging aspects of the CanMEDS roles valid outside Canada? , 2006, Medical education.

[139]  J. V. Vande Voort,et al.  Medical students speak: A two‐voice comment on learning professionalism in medicine , 2006, Clinical anatomy.

[140]  W. Pawlina Professionalism and anatomy: How do these two terms define our role? , 2006, Clinical anatomy.

[141]  H. Swick Medical professionalism and the clinical anatomist , 2006, Clinical anatomy.

[142]  W. Swartz Using gross anatomy to teach and assess professionalism in the first year of medical school , 2006, Clinical anatomy.

[143]  Kim Bartel Sheehan,et al.  E-mail Survey Response Rates: A Review , 2006, J. Comput. Mediat. Commun..

[144]  F. Hafferty Definitions of professionalism: a search for meaning and identity. , 2006, Clinical orthopaedics and related research.

[145]  R. Reid,et al.  Validating the Readiness for Interprofessional Learning Scale (RIPLS) in the postgraduate context: are health care professionals ready for IPL? , 2006, Medical education.

[146]  M. Parker Assessing professionalism: theory and practice , 2006, Medical teacher.

[147]  R. Cruess,et al.  Teaching professionalism: general principles , 2006, Medical teacher.

[148]  R. Horton Medicine: the prosperity of virtue , 2005, The Lancet.

[149]  W. Branch,et al.  Use of critical incident reports in medical education , 2005, Journal of general internal medicine.

[150]  M. D. de Villiers,et al.  The Delphi technique in health sciences education research , 2005, Medical teacher.

[151]  R. N. Remen,et al.  The Healer's Art: professionalism, service and mission , 2005, Medical education.

[152]  Justus J. Randolph Free-Marginal Multirater Kappa (multirater K[free]): An Alternative to Fleiss' Fixed-Marginal Multirater Kappa. , 2005 .

[153]  T. Huddle Viewpoint:: Teaching Professionalism: Is Medical Morality a Competency? , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[154]  Kevin W Eva,et al.  Self-Assessment in the Health Professions: A Reformulation and Research Agenda , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[155]  Godfrey Pell,et al.  Use and misuse of Likert scales , 2005, Medical education.

[156]  D. Stern,et al.  The nature of qualitative comments in evaluating professionalism , 2005, Medical education.

[157]  P. Jonge,et al.  The effects of teaching medical professionalism by means of vignettes: an exploratory study , 2005, Medical teacher.

[158]  L. Roberts,et al.  Becoming a Good Doctor: Perceived Need for Ethics Training Focused on Practical and Professional Development Topics , 2005, Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry.

[159]  S. Roff The Dundee Ready Educational Environment Measure (DREEM)—a generic instrument for measuring students’ perceptions of undergraduate health professions curricula , 2005, Medical teacher.

[160]  D. Irvine Patients, professionalism, and revalidation , 2005, BMJ : British Medical Journal.

[161]  T. O’Toole,et al.  Teaching Professionalism Within a Community Context: Perspectives from a National Demonstration Project , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[162]  S. K. Fields,et al.  Measuring Professionalism: A Review of Studies with Instruments Reported in the Literature between 1982 and 2002 , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[163]  M. Schuckit,et al.  Informal Mentoring Between Faculty and Medical Students , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[164]  A. Madill,et al.  Identity change and the human dissection experience over the first year of medical training. , 2005, Social science & medicine.

[165]  J van Tartwijk,et al.  The use of qualitative research criteria for portfolio assessment as an alternative to reliability evaluation: a case study , 2005, Medical education.

[166]  H. Slotnick,et al.  Proto‐professionalism: how professionalisation occurs across the continuum of medical education , 2005, Medical education.

[167]  C. Rees,et al.  Students' and assessors' attitudes towards students' self‐assessment of their personal and professional behaviours , 2005, Medical education.

[168]  C. Rees,et al.  The acceptability of 360‐degree judgements as a method of assessing undergraduate medical students' personal and professional behaviours , 2005, Medical education.

[169]  John R Boulet,et al.  Using a standardised patient assessment to measure professional attributes , 2005, Medical education.

[170]  J. Grimshaw,et al.  Applying the theory of planned behaviour to pharmacists' beliefs and intentions about the treatment of vaginal candidiasis with non-prescription medicines. , 2004, Family practice.

[171]  S. Jamieson Likert scales: how to (ab)use them , 2004, Medical education.

[172]  Adam N. Joinson,et al.  Personalization, authentication and self-disclosure in self-administered Internet surveys , 2004, Comput. Hum. Behav..

[173]  P. Hudelson Culture and quality: an anthropological perspective. , 2004, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[174]  Lorelei Lingard,et al.  Basing the Evaluation of Professionalism on Observable Behaviors: A Cautionary Tale , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[175]  Clive Seale,et al.  The hidden curriculum in undergraduate medical education: qualitative study of medical students' perceptions of teaching , 2004, BMJ : British Medical Journal.

[176]  A. McConnachie,et al.  The impact of a modern medical curriculum on students' proposed behaviour on meeting ethical dilemmas , 2004, Medical education.

[177]  J. Benbassat,et al.  What Is Empathy, and How Can It Be Promoted during Clinical Clerkships? , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[178]  W. Shrank,et al.  Fostering professionalism in medical education , 2004, Journal of General Internal Medicine.

[179]  J. Hanson,et al.  An Intentional Modeling Process to Teach Professional Behavior: Students' Clinical Observations of Preceptors , 2004, Teaching and learning in medicine.

[180]  D. Lynch,et al.  Assessing professionalism: a review of the literature , 2004, Medical teacher.

[181]  Kerin L Fresa-Dillon,et al.  Professionalism: Orientation Exercises for Incoming Osteopathic Medical Students and Developing Class Vision Statements , 2004, The Journal of the American Osteopathic Association.

[182]  K. Boon,et al.  Ethical and professional conduct of medical students: review of current assessment measures and controversies , 2004, Journal of Medical Ethics.

[183]  D. Abatemarco,et al.  Physician response rates to a mail survey by specialty and timing of incentive. , 2004, American journal of preventive medicine.

[184]  Elizabeth Morrison,et al.  Teaching empathy to first year medical students: evaluation of an elective literature and medicine course. , 2004, Education for health.

[185]  A. Jotkowitz,et al.  A physician charter on medical professionalism: a challenge for medical education. , 2004, European journal of internal medicine.

[186]  S. Gosling,et al.  Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires. , 2004, The American psychologist.

[187]  Eric B. Bass,et al.  Do Clerkship Directors Think Medical Students Are Prepared for the Clerkship Years? , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[188]  R. Cruess,et al.  "Profession": A Working Definition for Medical Educators , 2004, Teaching and learning in medicine.

[189]  H. Macleod,et al.  Role Modeling in Physicians’ Professional Formation: Reconsidering an Essential but Untapped Educational Strategy , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[190]  K. Szauter,et al.  Student Perceptions of the Professional Behavior of Faculty Physicians , 2003, Medical education online.

[191]  Stephen Sutton,et al.  Using the Internet to conduct surveys of health professionals: a valid alternative? , 2003, Family practice.

[192]  H. Brody,et al.  Ethics, Professionalism, and Humanities at Michigan State University College of Human Medicine , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[193]  L. Rucker,et al.  Can Poetry Make Better Doctors? Teaching the Humanities and Arts to Medical Students and Residents at the University of California, Irvine, College of Medicine , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[194]  David Trafimow,et al.  Predicting behaviour from perceived behavioural control: tests of the accuracy assumption of the theory of planned behaviour. , 2003, The British journal of social psychology.

[195]  C. Wynd,et al.  Two Quantitative Approaches for Estimating Content Validity , 2003, Western journal of nursing research.

[196]  M. Conner,et al.  Using the theory of planned behaviour to understand alcohol and tobacco use in students , 2003 .

[197]  L. Deloney The ICM Pin: A Symbol of Professional Development During Medical Education , 2003, Teaching and learning in medicine.

[198]  D. Rubio,et al.  Objectifying Content Validity: Conducting a Content Validity Study in Social Work Research , 2003 .

[199]  Martin Marshall,et al.  The quantitative measurement of organizational culture in health care: a review of the available instruments. , 2003, Health services research.

[200]  Shannon K. Gilmartin,et al.  Assessing Response Rates and Nonresponse Bias in Web and Paper Surveys , 2003 .

[201]  Martin Marshall,et al.  Does organisational culture influence health care performance? A review of the evidence , 2003, Journal of health services research & policy.

[202]  J. Gordon Fostering students' personal and professional development in medicine: a new framework for PPD , 2003, Medical education.

[203]  T. Niyonsenga,et al.  Changes in students' moral development during medical school: a cohort study. , 2003, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[204]  J. Norcini,et al.  The Mini-CEX: A Method for Assessing Clinical Skills , 2003, Annals of Internal Medicine.

[205]  M. Magee,et al.  Physician empathy in medical education and practice: experience with the Jefferson scale of physician empathy , 2003 .

[206]  J. Fins,et al.  Reflective Practice and Palliative Care Education: A Clerkship Responds to the Informal and Hidden Curricula , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[207]  Stephen R. Porter,et al.  The Impact of Contact Type on Web Survey Response Rates , 2003 .

[208]  Anthony J Frisby,et al.  An operational measure of physician lifelong learning: its development, components and preliminary psychometric data , 2003, Medical teacher.

[209]  Joanne Hoffman,et al.  An advanced communication skills course for fourth-year, post-clerkship students. , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[210]  D. Lie,et al.  Mediating the gap between the white coat ceremony and the ethics and professionalism curriculum. , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[211]  L. Deloney,et al.  Clinical skills center attending: an innovative senior medical school elective. , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[212]  G. Makoul,et al.  Early assessment of medical students' clinical skills. , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[213]  W. Leung,et al.  Defensive practice among psychiatrists: a questionnaire survey , 2002, Postgraduate medical journal.

[214]  L. Arnold,et al.  The role of spirituality in patient care: incorporating spirituality training into medical school curriculum. , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[215]  Jaclyn Moss,et al.  Use of electronic surveys in course evaluation , 2002, Br. J. Educ. Technol..

[216]  M. Ang Advanced communication skills: conflict management and persuasion. , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[217]  Susan J. Pasquale,et al.  Preparing medical students to teach. , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[218]  L. Arnold,et al.  The Role of Spirituality in Patient Care , 2002 .

[219]  A. Kalet,et al.  Mentoring for a new era. , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[220]  P. Wagner,et al.  Teaching communication skills: a skills-based approach. , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[221]  L. Rucker,et al.  Using literature as the framework for a new course. , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[222]  Thomas J Nasca,et al.  Physician empathy: definition, components, measurement, and relationship to gender and specialty. , 2002, The American journal of psychiatry.

[223]  Michael Wilkes,et al.  Understanding Social Influence in Medical Education , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[224]  L. Robins,et al.  Using the American Board of Internal Medicine's “Elements of Professionalism” for Undergraduate Ethics Education , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[225]  P. Teplitsky Perceptions of Canadian dental faculty and students about appropriate penalties for academic dishonesty. , 2002, Journal of dental education.

[226]  Brenda L Seago,et al.  Using a decade of data on medical student computer literacy for strategic planning. , 2002, Journal of the Medical Library Association : JMLA.

[227]  Medical Professionalism Medical professionalism in the new millennium: a physicians' charter , 2002, The Lancet.

[228]  E. Hundert,et al.  Defining and assessing professional competence. , 2002, JAMA.

[229]  G. Alroy,et al.  Teaching professionalism with the aid of trigger films , 2002, Medical teacher.

[230]  C. Philip,et al.  The White Coat Ceremony: Turning Trust Into Entitlement , 2002, Teaching and learning in medicine.

[231]  M. Conner,et al.  Efficacy of the Theory of Planned Behaviour: a meta-analytic review. , 2001, The British journal of social psychology.

[232]  D. Irvine Doctors in the UK: their new professionalism and its regulatory framework , 2001, The Lancet.

[233]  H. Loeser,et al.  Early Detection and Evaluation of Professionalism Deficiencies in Medical Students: One School's Approach , 2001, Academic medicine : journal of the Association of American Medical Colleges.

[234]  D. Lie,et al.  Using Standardized Patients to Assess Medical Students' Professionalism , 2001, Academic medicine : journal of the Association of American Medical Colleges.

[235]  S. Tattersall,et al.  Hospitalised patients' views on doctors and white coats , 2001, The Medical journal of Australia.

[236]  L. Côté,et al.  Senior Residents' Views on the Meaning of Professionalism and How They Learn about It , 2001, Academic medicine : journal of the Association of American Medical Colleges.

[237]  Edith D. de Leeuw,et al.  Reducing missing data in surveys: an overview of methods , 2001 .

[238]  C. Gjerde,et al.  The Interdisciplinary Generalist Curriculum Project at the University of Wisconsin Medical School: The Generalist Partners Program , 2001, Academic medicine : journal of the Association of American Medical Colleges.

[239]  Thomas J. Nasca,et al.  The Jefferson Scale of Physician Empathy: Development and Preliminary Psychometric Data , 2001 .

[240]  M.H. Davis,et al.  Portfolio assessment in medical students' final examinations , 2001, Medical teacher.

[241]  Russel L. Thompson,et al.  A Meta-Analysis of Response Rates in Web- or Internet-Based Surveys , 2000 .

[242]  G. Regehr,et al.  Context, Conflict, and Resolution: A New Conceptual Framework for Evaluating Professionalism , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[243]  R. Cruess,et al.  Professionalism and medicine's social contract. , 2000, The Journal of bone and joint surgery. American volume.

[244]  H. Swick Toward a Normative Definition of Medical Professionalism , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[245]  B. Castellani,et al.  The Development of Professionalism: Curriculum Matters , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[246]  A. Paolo,et al.  Response Rate Comparisons of E-Mail- and Mail-Distributed Student Evaluations , 2000, Teaching and learning in medicine.

[247]  M. Wynia,et al.  Medical professionalism in society. , 1999, The New England journal of medicine.

[248]  George Wright,et al.  The Delphi technique as a forecasting tool: issues and analysis , 1999 .

[249]  M. Cooke,et al.  A strategy for the detection and evaluation of unprofessional behavior in medical students. University of California, San Francisco School of Medicine Clinical Clerkships Operation Committee. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[250]  M. Whitcomb,et al.  Teaching professionalism in undergraduate medical education. , 1999, JAMA.

[251]  Mark Conner,et al.  Predictive validity of the theory of planned behaviour: The role of questionnaire format and social desirability , 1999 .

[252]  J A Spencer,et al.  Learner centred approaches in medical education , 1999, BMJ.

[253]  Linda Hutchinson,et al.  Evaluating and researching the effectiveness of educational interventions , 1999, BMJ.

[254]  Frances S. Grodzinsky,et al.  The practitioner from within: revisiting the virtues , 1999, CSOC.

[255]  M. Marshall How well do GPs and hospital consultants work together? A survey of the professional relationship. , 1999, Family practice.

[256]  L. Berkson,et al.  Clinical teachers as humanistic caregivers and educators: perceptions of senior clerks and second-year residents. , 1998, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[257]  K. Race,et al.  Can Professionalism Be Measured? The Development of a Scale for Use in the Medical Environment , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[258]  C. Enarson,et al.  Medical students' perceptions of unethical conduct at one medical school , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[259]  F. Hafferty Beyond curriculum reform: confronting medicine's hidden curriculum , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[260]  Mark Clayton Delphi: a technique to harness expert opinion for critical decision‐making tasks in education , 1997 .

[261]  A. Deehan,et al.  The effect of cash and other financial inducements on the response rate of general practitioners in a national postal study. , 1997, The British journal of general practice : the journal of the Royal College of General Practitioners.

[262]  D. Watson,et al.  Constructing validity: Basic issues in objective scale development , 1995 .

[263]  S. Haynes,et al.  Content validity in psychological assessment: A functional approach to concepts and methods. , 1995 .

[264]  D. Hunter,et al.  Qualitative Research: Consensus methods for medical and health services research , 1995 .

[265]  F. Kianifard,et al.  Evaluation of Clinimetric Scales: Basic Principles and Methods , 1994 .

[266]  M Verma,et al.  Assessment of clinical competence , 1994 .

[267]  N. Christakis,et al.  Do clinical clerks suffer ethical erosion? Students' perceptions of their ethical environment and personal development , 1994, Academic medicine : journal of the Association of American Medical Colleges.

[268]  R Gillon,et al.  Medical ethics: four principles plus attention to scope , 1994, BMJ.

[269]  William P. Dunlap,et al.  On the questionable soundness of factoring ipsative data: A response to Saville & Willson (1991) , 1994 .

[270]  I T Joliffe,et al.  Principal component analysis and exploratory factor analysis , 1992, Statistical methods in medical research.

[271]  John G. Geer,et al.  DO OPEN-ENDED QUESTIONS MEASURE “SALIENT” ISSUES? , 1991 .

[272]  W. Gregory,et al.  Attitudes to chemotherapy: comparing views of patients with cancer with those of doctors, nurses, and general public. , 1990, BMJ.

[273]  A. Bandura Human agency in social cognitive theory. , 1989, The American psychologist.

[274]  Blair H. Sheppard,et al.  The Theory of Reasoned Action: A Meta-Analysis of Past Research with Recommendations for Modifications and Future Research , 1988 .

[275]  M. Lynn Determination and quantification of content validity. , 1986, Nursing research.

[276]  R. Seymour,et al.  An evaluation of length and end-phrase of visual analogue scales in dental pain , 1985, Pain.

[277]  M. Bardecki,et al.  Participants' response to the Delphi method: An attitudinal perspective , 1984 .

[278]  T. M. F. Smith,et al.  On the validity of interferences from non-random samples , 1983 .

[279]  John P. Robinson,et al.  Questions and answers in attitude surveys , 1982 .

[280]  William L. Rankin,et al.  A comparison of ranking and rating procedures for value system measurement , 1980 .

[281]  J. Russell Affective space is bipolar. , 1979 .

[282]  C. H. Lawshe A QUANTITATIVE APPROACH TO CONTENT VALIDITY , 1975 .

[283]  刘江雪,et al.  LIN volume 11 issue 2 Cover and Back matter , 1975, Journal of Linguistics.

[284]  C. Dziuban,et al.  When is a correlation matrix appropriate for factor analysis? Some decision rules. , 1974 .

[285]  L. Kohlberg Stages and aging in moral development-some speculations. , 1973, The Gerontologist.

[286]  Wingate M. Johnson,et al.  Hippocratic oath‐modern version , 1945 .

[287]  H. Traue,et al.  The gross anatomy course: An analysis of its importance , 2010, Anatomical sciences education.

[288]  James Dean Brown,et al.  Choosing the Right Type of Rotation in PCA and EFA , 2009 .

[289]  T. M. Thai,et al.  Relationship of creative projects in anatomy to medical student professionalism , test performance and stress : an exploratory study , 2009 .

[290]  S. Roff,et al.  Developing stage-specific, consistent, reliable and valid learning, teaching and assessment methods for PolyProfessionalism in the health professions , 2009 .

[291]  Thomas J. Nasca,et al.  Assessing physicians’ orientation toward lifelong learning , 2007, Journal of General Internal Medicine.

[292]  Dr. William T. Branch Jr. Supporting the moral development of medical students , 2007, Journal of General Internal Medicine.

[293]  P. O'Sullivan,et al.  Defining the core competency of professionalism based on the patient’s perception , 2007, Clinical & experimental ophthalmology.

[294]  He Liang Principal Components Analysis in SPSS , 2007 .

[295]  C. Rees,et al.  The trouble with assessing students' professionalism: theoretical insights from sociocognitive psychology. , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[296]  Anders Baerheim,et al.  [Medical professionalism]. , 2007, Tidsskrift for den Norske laegeforening : tidsskrift for praktisk medicin, ny raekke.

[297]  Roger Tourangeau,et al.  Evaluating the Effectiveness of Visual Analog Scales : A Web Experiment , 2006 .

[298]  D. Chard,et al.  Medical professionalism: the trainees' views. , 2006, Clinical medicine.

[299]  S. Patten,et al.  Well-being in residency training: a survey examining resident physician satisfaction both within and outside of residency training and mental health in Alberta , 2005 .

[300]  V. Wass Doctors in society. Medical professionalism in a changing world. , 2005, Clinical medicine.

[301]  Martin Wetzels,et al.  Response Rate and Response Quality of Internet-Based Surveys: An Experimental Study , 2004 .

[302]  P. Duff Teaching and assessing professionalism in medicine. , 2004, Obstetrics and gynecology.

[303]  J. Grimshaw,et al.  Constructing questionnaires based on the theory of planned behaviour: A manual for health services researchers , 2004 .

[304]  Stephen R. Porter,et al.  Multiple Surveys of Students and Survey Fatigue. , 2004 .

[305]  G. Regehr,et al.  The disavowed curriculum: understanding student's reasoning in professionally challenging situations. , 2003, Journal of general internal medicine.

[306]  C. Powell The Delphi technique: myths and realities. , 2003, Journal of advanced nursing.

[307]  I. Ajzen Constructing a TpB Questionnaire: Conceptual and Methodological Considerations , 2002 .

[308]  L. Barozzi,et al.  Medical Professionalism in the New Millennium: A Physician Charter , 2002, Annals of Internal Medicine.

[309]  J. Savage,et al.  Participant observation, informed consent and ethical approval. , 2002, Nurse researcher.

[310]  J. Herold,et al.  Physician response to surveys. A review of the literature. , 2001, American journal of preventive medicine.

[311]  Ronald M. Harden,et al.  AMEE Guide No. 14: Outcome-based education: Part 1-An introduction to outcome-based education , 1999 .

[312]  D. Wren,et al.  School culture: exploring the hidden curriculum. , 1999, Adolescence.

[313]  J. DeCoster Overview of Factor Analysis , 1998 .

[314]  S. Roff,et al.  Development and validation of the Dundee Ready Education Environment Measure (DREEM) , 1997 .

[315]  B. Hurwitz,et al.  Swearing to care: the resurgence in medical oaths. , 1997, BMJ.

[316]  C. V. D. van der Vleuten,et al.  The assessment of professional competence: Developments, research and practical implications. , 1996, Advances in health sciences education : theory and practice.

[317]  Edgar H. Schein,et al.  Coming to a new awareness of organizational culture , 1984 .

[318]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.