Hunting and gathering: new imperatives in mapping and collecting student learning data to assure quality outcomes

Assurance of learning (AOL) is a quality enhancement and quality assurance process used in higher education. It involves a process of determining programme learning outcomes and standards, and systematically gathering evidence to measure students' performance on these. The systematic assessment of whole-of-programme outcomes provides a basis for curriculum development and management, continuous improvement, and accreditation. To better understand how AOL processes operate, a national study of university practices across one discipline area, business and management, was undertaken. To solicit data on AOL practice, interviews were undertaken with a sample of business school representatives (n = 25). Two key processes emerged: (1) mapping of graduate attributes and (2) collection of assurance data. External drivers such as professional accreditation and government legislation were the primary reasons for undertaking AOL outcomes but intrinsic motivators in relation to continuous improvement were also evident. The facilitation of academic commitment was achieved through an embedded approach to AOL by the majority of universities in the study. A sustainable and inclusive process of AOL was seen to support wider stakeholder engagement in the development of higher education learning outcomes.

[1]  K. Fox.  The Self-Esteem Complex and Youth Fitness , 1988 .

[2]  S. Barrie,et al.  Rethinking Generic Graduate Attributes , 2005 .

[3]  R. Gephart.  Qualitative Research and the Academy of Management Journal , 2004 .

[4]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[5]  Chris Rust,et al.  The Student Experience of Criterion-Referenced Assessment (Through the Introduction of a Common Criteria Assessment Grid) , 2001 .

[6]  Rochelle E. Tractenberg,et al.  A Mastery Rubric: guiding curriculum design, admissions and development of course objectives , 2010, Assessment and evaluation in higher education.

[7]  Jennifer Sumsion,et al.  Identifying generic skills through curriculum mapping: a critical evaluation , 2004 .

[8]  Paul Hager,et al.  Graduate attributes, learning and employability , 2007 .

[9]  W. Bennis,et al.  How business schools lost their way. , 2005, Harvard business review.

[10]  Damian Hine,et al.  Extending teaching and learning initiatives in the cross-disciplinary field of biotechnology: final report , 2008 .

[11]  Owen P. Hall,et al.  Learning Assurance Using Business Simulations Applications to Executive Management Education , 2014 .

[12]  Paul Hager,et al.  Nature And Development of Generic Attributes , 2006 .

[13]  Carolyn Haynes,et al.  Targeted Assessment Rubric: An Empirically Grounded Rubric for Interdisciplinary Writing , 2009 .

[14]  Mantz Yorke,et al.  Embedding employability into the curriculum , 2006 .

[15]  Natasha A. Jankowski,et al.  Using Assessment Results: Promising Practices of Institutions That Do It Well. , 2012 .

[16]  Hamish Coates,et al.  An international assessment of bachelor degree graduates' learning outcomes , 2012 .

[17]  Geoffrey Cullinan,et al.  When to walk away from a deal. , 2004, Harvard business review.

[18]  M. Gallagher.  Improving Institutional Effectiveness: The Relationship between Assessing Student Learning Outcomes and Strategic Planning in California Community Colleges. , 2008 .

[19]  Ron James Fisher,et al.  Assessment literacy and student learning: the case for explicitly developing students ‘assessment literacy’ , 2013 .

[20]  Hamish Coates,et al.  Defining and monitoring academic standards in Australian higher education , 2010 .

[21]  Melissa S Medina,et al.  A curriculum review and mapping process supported by an electronic database system. , 2008, American journal of pharmaceutical education.

[22]  Rachael M. Field,et al.  Bachelor of Laws : learning and teaching academic standards statement : December 2010 [Learning and Teaching Academic Standards Project] , 2010 .

[23]  A. Rosie,et al.  Students at the heart of the system , 2011 .

[24]  Kathryn A. Martell,et al.  Assessing Student Learning: Are Business Schools Making the Grade? , 2007 .

[25]  Assurance of Learning (AoL) Methods Just Have to Be Good Enough , 2007 .

[26]  J. Biggs,et al.  Teaching For Quality Learning At University , 1999 .

[27]  Beverley Oliver,et al.  Final report. Teaching Fellowship: Benchmarking partnerships for graduate employability , 2010 .

[28]  Justine Vaisutis,et al.  Sydney & New South Wales , 2007 .

[29]  Terrel L. Rhodes.  Assessing outcomes and improving achievement : tips and tools for using rubrics , 2010 .

[30]  Deborah Nusche,et al.  Assessment of Learning Outcomes in Higher Education: A Comparative Review of Selected Practices. OECD Education Working Papers, No. 15. , 2008 .

[31]  R M Harden,et al.  An international virtual medical school (IVIMEDS): the future for medical education? , 2002, Medical teacher.

[32]  Chris Sykes,et al.  Business as usual A collaborative and inclusive investigation of existing resources, strengths, gaps and challenges to be addressed for sustainability in teaching and learning in Australian university business faculties. , 2008 .

[33]  John Stephenson,et al.  Capability and quality in higher education , 1998 .

[34]  Ian Drummond,et al.  Personal transferable skills in higher education: the problems of implementing good practice , 1998 .

[35]  Sarah J. Stein,et al.  Beyond mapping and embedding graduate attributes: bringing together quality assurance and action learning to create a validated and living curriculum , 2004 .

[36]  Janis Bailey,et al.  Capping them off! Exploring and explaining the patterns in undergraduate capstone subjects in Australian business schools , 2014 .

[37]  Kayoko Uchiyama,et al.  Curriculum Mapping in Higher Education: A Vehicle for Collaboration , 2009 .

[38]  Romy Lawson,et al.  Facilitating staff and student engagement with graduate attribute development, assessment and standards in business faculties , 2009 .