Making Sense of Student Feedback Using Text Analysis--Adapting and Expanding a Common Lexicon.

Purpose This paper aims to report the findings of a study into the automated text analysis of student feedback comments to assist in investigating a high volume of qualitative information at various levels in an Australian university. It includes the drawbacks and advantages of using selected applications and established lexicons. There has been an emphasis on the analysis of the statistical data collected using student surveys of learning and teaching, while the qualitative comments provided by students are often not systematically scrutinised. Student comments are important, as they provide a level of detail and insight that are imperative to quality assurance practices. Design/methodology/approach The paper outlines the process by which the institution researched, developed and implemented the automated analysis of student qualitative comments in surveys of units and teaching. Findings The findings indicated that there are great benefits in implementing this automated process, particularly in the analysis of evaluation data for units with large enrolments. The analysis improved efficiency in the interpretation of student comments. However, a degree of human intervention is still required in creating reports that are meaningful and relevant to the context. Originality/value This paper is unique in its examination of one institution’s journey in developing a process to support academics staff in interpreting and understanding student comments provided in surveys of units and teaching.

[1]  C. S. Nair,et al.  Student feedback: a learning and teaching performance indicator , 2015 .

[2]  S. Moore,et al.  Students evaluating teachers: exploring the importance of faculty reaction to feedback on teaching , 2005 .

[3]  Lyn Alderman,et al.  Student feedback systems in higher education: a focused literature review and environmental scan , 2012 .

[4]  Teachers' approaches to teaching and responses to student evaluation in a problem‐based medical program , 2007 .

[5]  L. Bickman,et al.  The SAGE Handbook of Applied Social Research Methods , 2009 .

[6]  Alice E. Hoon,et al.  Use of the ‘Stop, Start, Continue’ method is associated with the production of constructive qualitative feedback by students in higher education , 2015 .

[7]  Gary Tan,et al.  Profiling Teacher/Teaching Using Descriptors Derived from Qualitative Feedback: Formative and Summative Applications , 2009 .

[8]  Lee Harvey,et al.  The nexus of feedback and improvement , 2011 .

[9]  Winai Wongsurawat What's a comment worth? How to better understand student evaluations of teaching , 2011 .

[10]  Nathan E. Gonyea,et al.  Reining in student comments: a model for categorising and studying online student comments , 2012 .

[11]  Tena B. Crews,et al.  Online Course Evaluations: Faculty Perspective and Strategies for Improved Response Rates , 2011 .

[12]  Dimitri Mortelmans,et al.  The Student as a Commentator: Students’ Comments in Student Evaluations of Teaching , 2012 .

[13]  Beatrice Tucker,et al.  Outcomes and evaluations: Is there a relationship between indicators of student success and student evaluations of learning? , 2012 .

[14]  Geoff Scott,et al.  Using qualitative data to prove and improve quality in Australian higher education , 2008 .

[15]  M. Shah Listening to students' voices to enhance their experience of university , 2013 .

[16]  Ieva Stupans,et al.  Student Evaluation of Teaching: A Study Exploring Student Rating Instrument Free-form Text Comments , 2016 .

[17]  S. Watson Closing the Feedback Loop: Ensuring Effective Action from Student Feedback , 2003 .

[18]  Stuart Palmer,et al.  Student evaluation of teaching: keeping in touch with reality , 2012 .

[19]  Lee Harvey,et al.  Student Feedback [1] , 2003 .

[20]  B. Tucker,et al.  Student evaluation to improve the student learning experience: an Australian university case study , 2013 .

[21]  Sandra C. Jones Measuring the Quality of Higher Education: linking teaching quality measures at the delivery level to administrative measures at the university level , 2003 .

[22]  Fadia Nasser-Abu Alhija,et al.  Student evaluation of instruction: What can be learned from students’ written comments? , 2009 .

[23]  Mahsood Shah,et al.  Student voice: using qualitative feedback from students to enhance their university experience , 2013 .