Eliciting student feedback for course development: the application of a qualitative course evaluation tool among business research students

Abstract Student evaluations of teaching and learning are playing an increasingly important role in the delivery of high-quality, student-centred education. Insights into student perceptions of their learning experience provide important information that can be used to inform course design and development. The majority of course evaluations take the form of quantitative surveys, but research suggests that a reliance on survey data alone can be problematic from a teaching and learning perspective. Qualitative course evaluations have been cited as a viable alternative to quantitative evaluations, but less research has been conducted into their efficacy when compared to quantitative evaluations. The study on which this article reports attempted to contribute to addressing this shortcoming by describing and assessing a novel approach to eliciting qualitative feedback from students in a research methodology course at a higher education institution in South Africa. Conventional content analysis was used to analyse the qualitative feedback received from students. The qualitative course evaluation approach was then appraised in terms of the degree to which it has the potential to overcome the shortcomings associated with quantitative course evaluations and the extent to which the information gathered could be used to improve the design and delivery of the academic programme.

[1]  Ieva Stupans,et al.  Student Evaluation of Teaching: A Study Exploring Student Rating Instrument Free-form Text Comments , 2016 .

[2]  F. Gaillard,et al.  Students, Faculty, And Administrators Perception Of Students Evaluations Of Faculty In Higher Education Business Schools , 2011 .

[3]  M. Macaulay,et al.  Gender, student perceptions, institutional commitments and academic dishonesty: who reports in academic dishonesty cases? , 2004 .

[4]  M. Shah,et al.  Using Student Voice to Improve Student Satisfaction: Two Australian Universities the Same Agenda , 2009 .

[5]  M. Chapple,et al.  The Nominal Group Technique: extending the evaluation of students' teaching and learning experiences , 1996 .

[6]  Mahsood Shah,et al.  Student voice: using qualitative feedback from students to enhance their university experience , 2013 .

[7]  Chenicheri Sid Nair,et al.  Benchmarking for the effective use of student evaluation data , 2015 .

[8]  Dimitri Mortelmans,et al.  The Student as a Commentator: Students’ Comments in Student Evaluations of Teaching , 2012 .

[9]  Stephen Darwin,et al.  What contemporary work are student ratings actually doing in higher education , 2017 .

[10]  Clinton Golding,et al.  Evaluate to improve: useful approaches to student evaluation , 2016 .

[11]  L. M. Aleamoni Student Rating Myths Versus Research Facts from 1924 to 1998 , 1999 .

[12]  Feifei Han,et al.  Assessing the impact of a university teaching development programme , 2012 .

[13]  Susan Greener,et al.  Business Research Methods , 2008 .

[14]  John T. E. Richardson,et al.  Instruments for obtaining student feedback: a review of the literature , 2005 .

[15]  Judy McKimm,et al.  Improved quality and quantity of written feedback is associated with a structured feedback proforma , 2012, Journal of Educational Evaluation for Health Professions.

[16]  Curt J. Dommeyer,et al.  Attitudes of Business Faculty Towards Two Methods of Collecting Teaching Evaluations: Paper vs. Online , 2002 .

[17]  Sarah J. Stein,et al.  Tertiary teachers and student evaluations: never the twain shall meet? , 2013 .

[18]  Monitoring trends in research student experience , 2017 .

[19]  A. Linse Interpreting and using student ratings data: Guidance for faculty serving as administrators and on evaluation committees , 2017 .

[20]  Fadia Nasser-Abu Alhija,et al.  Teaching in higher education: Good teaching through students’ lens , 2017 .

[21]  Larry D. Crumbley,et al.  Students’ perceptions of the evaluation of college teaching , 2001 .

[22]  M. Shah,et al.  Commencing student experience: new insights and implications for action , 2012 .

[23]  Dominique A. Greer,et al.  Learner-focused evaluation cycles: facilitating learning using feedforward, concurrent and feedback evaluation , 2014 .

[24]  Jeannette Kindred,et al.  "He Will Crush You Like an Academic Ninja!": Exploring Teacher Ratings on Ratemyprofessors.com , 2006, J. Comput. Mediat. Commun..

[25]  L. Schmelkin,et al.  Student Perspectives on Teaching and its Evaluation , 2002 .

[26]  Mohammad Ahmadi,et al.  Business students’ perceptions of faculty evaluations , 2001 .

[27]  Hongyan Yu,et al.  The Use of Collaborative Midterm Student Evaluations to Provide Actionable Results , 2016 .

[28]  S. R. Wickramasinghe,et al.  Mid-Semester Student Feedback Enhances Student Learning , 2006 .

[29]  D. Kember,et al.  Does the Use of Student Feedback Questionnaires Improve the Overall Quality of Teaching? , 2002 .

[30]  Tobias Wolbring,et al.  Selection Bias in Students’ Evaluation of Teaching , 2016 .

[31]  P. Chad The Use of Team-Based Learning as an Approach to Increased Engagement and Learning for Marketing Students , 2012 .

[32]  George D. Kuh,et al.  Myths and misconceptions about using qualitative methods in assessment , 2007 .

[33]  Alice E. Hoon,et al.  Use of the ‘Stop, Start, Continue’ method is associated with the production of constructive qualitative feedback by students in higher education , 2015 .

[34]  Winai Wongsurawat What's a comment worth? How to better understand student evaluations of teaching , 2011 .

[35]  Geoff Scott,et al.  Using qualitative data to prove and improve quality in Australian higher education , 2008 .

[36]  Tony Chambers What I Hear You Saying Is... : Analysis of Student Comments from the NSSE. , 2010 .

[37]  Katharina Brandl,et al.  Student evaluation team focus groups increase students’ satisfaction with the overall course evaluation process , 2017, Medical education.

[38]  Calvin Smith Building effectiveness in teaching through targeted evaluation and response: connecting evaluation to teaching improvement in higher education , 2008 .

[39]  Mary C. Wright,et al.  Consulting the Delphi: A New Idea for Collecting Student Feedback through the Two Survey Method (TSM). , 2010 .

[40]  Siraj Muhammed Pandhiani,et al.  Analysis of Factors Affecting Student Evaluation of Teaching Effectiveness in Saudi Higher Education: The Case of Jubail University College , 2017 .

[41]  P. Spooren,et al.  On the Validity of Student Evaluation of Teaching , 2013 .

[42]  M. Malliaris,et al.  Online Course Evaluations Response Rates , 2013 .

[43]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[44]  M. Huxham,et al.  Collecting student feedback: a comparison of questionnaire and other methods , 2008 .

[45]  Kerry Dobbins,et al.  Are we serious about enhancing courses? Using the principles of assessment for learning to enhance course evaluation , 2013 .

[46]  Jing Zhao,et al.  Student evaluation of instruction in higher education: exploring issues of validity and reliability , 2012 .

[47]  Malgorzata Erikson,et al.  Student responses to a reflexive course evaluation , 2016 .

[48]  A. Cook-Sather,et al.  Sound, Presence, and Power: “Student Voice” in Educational Research and Reform , 2006 .

[49]  Yining Chen,et al.  Student Evaluation of Teaching Effectiveness: An assessment of student perception and motivation , 2003 .

[50]  Joshua Freeman,et al.  Using a modified nominal group technique as a curriculum evaluation tool. , 2004, Family medicine.

[51]  D. Chulkov,et al.  Challenges in designing student teaching evaluations in a business program , 2012 .

[52]  Ian Willis,et al.  Focus Group meets Nominal Group Technique: an effective combination for student evaluation? , 2017 .

[53]  Wynetta Y. Lee Assessment and evaluation in higher education , 2010 .

[54]  Angela R. Penny Changing the Agenda for Research into Students' Views about University Teaching: Four shortcomings of SRT research , 2003 .

[55]  William E. Cashin,et al.  Student Ratings of Teaching : A Summary of Research and Literature , 2012 .

[56]  J. Price,et al.  How do we rate? An evaluation of online student evaluations , 2009 .

[57]  Lyn Alderman,et al.  Student feedback systems in higher education: a focused literature review and environmental scan , 2012 .

[58]  Erik Blair,et al.  Improving higher education practice through student evaluation systems: is the student voice being heard? , 2014 .

[59]  D. Nestel,et al.  Benefits and challenges of focus groups in the evaluation of a new Graduate Entry Medical Programme , 2012 .