Closing the loop on student feedback: the case of Australian and Scottish universities

Universities have a long history of collecting student feedback using surveys and other mechanisms. The last decade has witnessed a significant shift in how student feedback is systematically collected, analysed, reported, and used by governments and institutions. This shift is due to a number of factors, including changes in government policy related to quality assurance, and the increased use of the results by various stakeholders such as governments, institutions, and potential students and employers. The collection, analysis, and reporting of results are systematically carried out in many institutions worldwide. However, how to use student feedback to effectively improve student learning experience remains an issue to be addressed. This paper will contribute to this debate by comparing how Australian and Scottish universities use student feedback results to inform improvements. Based on thematic analysis of external quality audit reports of all Australian and Scottish universities, this paper suggests that universities have systematic processes to collect student feedback using a range of mechanisms, but limited work is done to use the data to inform improvements. This paper argues the need for universities to genuinely listen to student voice by facilitating partnership between students and institutions to act on their feedback as part of quality assurance.

[1]  M. Shah.  Ten years of external quality audit in Australia: evaluating its effectiveness and success , 2012 .

[2]  D. Eastwood,et al.  Counting What Is Measured or Measuring What Counts? League Tables and Their Impact On Higher Education Institutions in England , 2008 .

[3]  Sandra C. Jones,et al.  Online student evaluation improves Course Experience Questionnaire results in a physiotherapy program , 2008 .

[4]  Kristopher Hardy,et al.  First-year experience , 2014 .

[5]  Mahsood Shah,et al.  Monitoring Trends in Student Satisfaction , 2013 .

[6]  Chenicheri Sid Nair,et al.  Benchmarking for the effective use of student evaluation data , 2015 .

[7]  Leonid Grebennikov,et al.  University of Western Sydney Students at Risk: Profile and Opportunities for Change. , 2008 .

[8]  Hamish Coates,et al.  Engaging university students : international insights from system-wide studies , 2014 .

[9]  Sally Brown.  Bringing about positive change in the higher education student experience: a case study , 2011 .

[10]  Simon Marginson,et al.  The determinants of quality national higher education systems , 2013 .

[11]  Light Greg,et al.  Learning and teaching in higher education , 2001 .

[12]  B. Tucker,et al.  Development of a student evaluation quality culture: the eVALUate experience at Curtin University , 2013 .

[13]  Paul D. Umbach,et al.  Nonresponse and Online Student Evaluations of Teaching: Understanding the Influence of Salience, Fatigue, and Academic Environments , 2012 .

[14]  Chenicheri Sid Nair,et al.  Survey Platform: A Factor Influencing Online Survey Delivery and Response Rate , 2009 .

[15]  M. Shah,et al.  Commencing student experience: new insights and implications for action , 2012 .

[16]  Peter Seldin,et al.  Changing practices in faculty evaluation , 1985 .

[17]  Lorraine Bennett,et al.  A recipe for effective participation rates for web‐based surveys , 2010 .

[18]  Kerri-Lee Krause,et al.  Students’ engagement in first‐year university , 2008 .

[19]  Michael Prosser,et al.  The First Year Experience Project: A model for university-wide change , 2001 .

[20]  K. Price,et al.  Measuring Students’ Engagement on College Campuses: Is the NSSE an Appropriate Measure of Adult Students’ Engagement? , 2012 .

[21]  Robert W. Hanna,et al.  Gathering faculty teaching evaluations by in‐class and online surveys: their effects on response rates and evaluations , 2004 .

[22]  M. Shah,et al.  Using Student Voice to Improve Student Satisfaction: Two Australian Universities the Same Agenda , 2009 .

[23]  W. V. Os.  Feedback from student ratings and the improvement of teaching performance , 2010 .

[24]  Hamish Coates,et al.  2012 University Experience Survey National Report , 2012 .

[25]  David Kane,et al.  Student Satisfaction Surveys: The Value in Taking an Historical Perspective , 2008 .

[26]  ไพบูลย์ จงผิตะ,et al.  Change by Design : How Design Thinking Transforms Organizations and Inspires Innovation , 2012 .

[27]  Jeffrey R. Stowell,et al.  Comparison of online and classroom-based student evaluations of instruction , 2012 .

[28]  J. Kirk,et al.  Reliability and Validity in Qualitative Research , 1985 .

[29]  David Dunne,et al.  Design Thinking and How It Will Change Management Education: An Interview and Discussion , 2006 .

[30]  Stuart Hall,et al.  Closing the Loop: The Impact of Student Feedback on Students' Subsequent Learning. Research Report Series. , 1998 .

[31]  Roy Ballantyne,et al.  Beyond Student Evaluation of Teaching: Identifying and addressing academic staff development needs , 2000 .

[32]  C. S. Nair,et al.  The Changing Nature of Teaching and Unit Evaluations in Australian Universities. , 2012 .

[33]  Sarah J. Stein,et al.  Can you increase teacher engagement with evaluation simply by improving the evaluation system? , 2016 .

[34]  J. Creswell.  Qualitative inquiry and research design: Choosing among five approaches, 2nd ed. , 2007 .

[35]  Quality in action: closing the loop , 2010 .

[36]  John A. Clarke,et al.  Enhancing the transition of commencing students into university: an institution-wide approach , 2012 .

[37]  April Bleske-Rechek,et al.  RateMyProfessors com: Testing Assumptions about Student Use and Misuse , 2010 .

[38]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[39]  H. Coates.  The value of student engagement for higher education quality assurance , 2005 .

[40]  Beatrice Tucker,et al.  Outcomes and evaluations: Is there a relationship between indicators of student success and student evaluations of learning? , 2012 .

[41]  G. Boysen,et al.  The (mis)interpretation of teaching evaluations by college faculty and administrators , 2014 .

[42]  John Brennan,et al.  Collecting and Using Student Feedback on Quality and Standards of Learning and Teaching in Higher Education (Report No. RD08/03) , 2003 .

[43]  Janet Leckey,et al.  Quantifying Quality: The importance of student feedback , 2001 .

[44]  S. Kift,et al.  Transition pedagogy: A third generation approach to FYE - A case study of policy and practice for the higher education sector , 2010 .

[45]  Peter Westwood,et al.  Visible learning and the science of how we learn , 2014 .

[46]  S. Watson.  Closing the Feedback Loop: Ensuring Effective Action from Student Feedback , 2003 .

[47]  B. Tucker,et al.  Student evaluation to improve the student learning experience: an Australian university case study , 2013 .

[48]  Susan A. Ariew,et al.  National Survey of Student Engagement , 2003 .

[49]  Alexander C. McCormick,et al.  Engaging University Students , 2014 .

[50]  Mahsood Shah,et al.  Student voice: using qualitative feedback from students to enhance their university experience , 2013 .

[51]  John T. E. Richardson,et al.  Is the enhancement of student experience a strategic priority in Australian universities? , 2016 .

[52]  J. R. Scotti,et al.  Available From , 1973 .

[53]  Clifford Nowell,et al.  Assessing faculty performance using student evaluations of teaching in an uncontrolled setting , 2010 .