Evaluation methodology for work integrated learning - placements : a discussion paper

Background: This paper will address the evaluation of WIL (placements) in order to provide a strategy to improve performance in universities' WIL as benchmarked in the AUSSE, GDS and placement unit feedback. Overview of issue: Although WIL placements are important and valuable for student engagement, learning, graduate employability and industry partnerships, there are few empirical studies or reviews that inform evaluation methodology for them. The assessment of placement outcomes and the student experience is typically more complex than evaluation of a standard university unit because of the wide variation that occurs with placements. Students are likely to be working in different organisations, and working on different projects within their various disciplines. Adding to this complexity, the organisation supervisor is an additional stakeholder critical to the placement experience, and who ultimately makes the judgment of student performance. Although an organisation supervisor may complete an individual feedback form for their students, generally this information is not strategically aligned within a broader university evaluation process. Initial examination of available literature revealed that the multi-dimensional perspective (organisational supervisor, placement co-ordinator and student) is not usually incorporated into evaluation of placements to inform continuous improvement for example. There are gaps in the evaluation process which could be addressed through more  comprehensive evaluation that could be utilised across Faculties and Institutions. In 2010, we will conduct an inter-faculty project to develop and trial an evaluation methodology for WIL placements. It will incorporate a triangulated approach including student, organisation and university supervisor feedback. Preliminary results gained from this project will be discussed. Argument: An evaluation methodology that is inclusive of a triangulated approach, would provide university stakeholders with comprehensive feedback that could be used to strategically inform continuous improvement efforts in Institutions in the areas of WIL placements. Implications: The importance of triangulated data gathering leading to a comprehensive evaluation and subsequent improvement strategies will be concluded. Suggested evaluation process and potential tools will be presented.

[1]  Ern Reeders,et al.  Scholarly Practice in Work-based Learning: Fitting the glass slipper , 2000 .

[2]  Danny K.Y. Wong,et al.  Towards the development of a work integrated learning unit , 2002 .

[3]  J. Biggs Enhancing teaching through constructive alignment , 1996 .

[4]  Heather Allison,et al.  Development of the student placement evaluation form: A tool for assessing student fieldwork performance , 2004 .

[5]  C. Lindsay,et al.  The Concept of Employability , 2005 .

[6]  S. Moon,et al.  Graduates' Work: Organisational Change and Students' Attributes. , 1997 .

[7]  D. Stufflebeam The CIPP Model for Evaluation , 2000 .

[8]  S. A. Cohen,et al.  Instructional Alignment: Searching for a Magic Bullet , 1987 .

[9]  Gary D. Lock,et al.  Work placement experience: should I stay or should I go? , 2009 .

[10]  Lyndel Bates,et al.  Preparing students for the professional workplace: who has responsibility for what? , 2007 .

[11]  R. Bridgstock The graduate attributes we’ve overlooked: enhancing graduate employability through career management skills , 2009 .

[12]  Wendy Green,et al.  Facing up to the challenge: why is it so hard to develop graduate attributes? , 2009 .

[13]  Kieran O’Donoghue,et al.  Assessing Social Work Field Education: Towards Standardising Fieldwork Assessment in New Zealand , 2009 .

[14]  Brett David Freudenberg,et al.  It’s All about 'I': Implementing 'Integration' into a WIL Program , 2009 .

[15]  Joan Richardson,et al.  A framework for assessing work integrated learning , 2009 .

[16]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[17]  M. Bates,et al.  Developing generic skills at university, during work placement and in employment: graduates' perceptions , 2004 .

[18]  D. Sims,et al.  Learning on Work Placement: The Narrative Development of Social Competence , 2009 .

[19]  Lee Harvey,et al.  Defining and Measuring Employability , 2001 .

[20]  A. Hammond,et al.  Considered evaluation of clinical placements in a new medical school , 2009 .

[21]  M. Scriven Evaluation Theory and Metatheory , 2003 .

[22]  Calvin Douglas Smith,et al.  Design‐focused evaluation , 2008 .