Investigating the Effects of Group Response Systems on Student Satisfaction, Learning and Engagement in Accounting Education

We examine group response systems (GRS) as an educational tool. We use an experimental approach and student survey data to assess vendors' claims that GRS improve student engagement and feedback, and thus improve learning. A key part of our design involves controlling for effects of moving to a more interactive pedagogy that have been found to affect learning. For a management accounting course, we find only limited GRS learning effects, as proxied by exam performance. Contrary to our expectations, we find a decline in engagement, as proxied by student oral participation, when GRS are used. We also find little evidence that GRS lead to greater student satisfaction with the course. We do find support for student satisfaction with GRS, from which we infer that implementation problems are not driving our results. In summary, we find little support for vendor claims, when controlling for changes in pedagogy.

[1]  Margaret I. Brown,et al.  Increasing interactivity in lectures using an electronic voting system , 2004, J. Comput. Assist. Learn..

[2]  Paul T. P. Wong,et al.  When people ask "why" questions, and the heuristics of attributional search. , 1981 .

[3]  Quintin Cutts,et al.  Electronically enhanced classroom interaction , 2002 .

[4]  E. Mazur,et al.  Peer Instruction: Ten years of experience and results , 2001 .

[5]  E. Wit Who wants to be… The use of a personal response system in statistics teaching , 2003 .

[6]  R. Hastie Causes and effects of causal attribution , 1984 .

[7]  Robert R. Weaver,et al.  Classroom Organization and Participation: College Students' Perceptions , 2005 .

[8]  Eugene Judson,et al.  Learning from Past and Present: Electronic Response Systems in College Lecture Halls , 2002 .

[9]  Eric Mazur,et al.  Peer Instruction: A User's Manual , 1996 .

[10]  P. Winne,et al.  Feedback and Self-Regulated Learning: A Theoretical Synthesis , 1995 .

[11]  Robert J. Dufresne,et al.  Classtalk: A classroom communication system for active learning , 1996, J. Comput. High. Educ..

[12]  Chen-Lin C. Kulik,et al.  Timing of Feedback and Verbal Learning , 1988 .

[13]  Chen-Lin C. Kulik,et al.  The Instructional Effect of Feedback in Test-Like Events , 1991 .

[14]  Jeremy Roschelle,et al.  Classroom Response and Communication Systems: Research Review and Theory , 2004 .

[15]  Regina Vollmeyer,et al.  A Surprising Effect of Feedback on Learning. , 2005 .

[16]  Diana Laurillard,et al.  Rethinking University Teaching: A Framework for the Effective Use of Educational Technology , 1993 .

[17]  J. Poulis,et al.  Physics lecturing with audience paced feedback , 1998 .

[18]  S. Davis Observations in classrooms using a network of handheld devices , 2003, J. Comput. Assist. Learn..

[19]  Angela Carbone,et al.  Using an Electronic Voting System to Promote Active Reflection on Coursework Feedback , 2004 .

[20]  D. Nicol,et al.  Peer Instruction versus Class-wide Discussion in Large Classes: A comparison of two interaction methods in the wired classroom , 2003 .

[21]  Pravin K. Trivedi,et al.  Regression Analysis of Count Data , 1998 .