Gamification and Student Engagement with a Curriculum-based Measurement System

In this study, we employed a random control experiment to evaluate the effectiveness of gamification (e.g. scores, goal, progressive bar, etc.) and initial task difficulty on college student engagement in computer-based assessments. A group of Chinese college students (N=97) were randomly assigned to four groups obtained by crossing the two independent variables: gamification (with or without) and initial difficulty level (low or normal). The experiment lasted for 35 minutes, and each student was asked to complete several mini-tests (named maze tests). Student engagement was measured by the average off-task time between two maze tests. The results showed that both gamification and low-difficulty entry level reduced students’ off-task time.  However, the gamification effect was only significant for male students but not for female students. The study also demonstrated that the maze test can be a potential method to predict the general English proficiency with Chinese English language learners.

[1]  Juho Hamari,et al.  Demographic differences in perceived benefits from gamification , 2014, Comput. Hum. Behav..

[2]  Marina Papastergiou,et al.  Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation , 2009, Comput. Educ..

[3]  Qiang Wang,et al.  The National Curriculum Changes and Their Effects on English Language Teaching in the People’s Republic of China , 2007 .

[4]  Rebecca L. Oxford,et al.  A Closer Look at Learning Strategies, L2 Proficiency, and Gender , 1995 .

[5]  Lynn S. Fuchs,et al.  Using Curriculum‐Based Measurement to Improve Student Achievement: Review of Research , 2005 .

[6]  Susan Rose,et al.  Considering the Design of an Electronic Progress-Monitoring System , 2013 .

[7]  Stanley L. Deno,et al.  Curriculum-Based Measures: Development and Perspectives , 2003 .

[8]  G. T. Jackson,et al.  Motivation and performance in a game-based intelligent tutoring system , 2013 .

[9]  Daniel M. Johnson,et al.  Effective affective user interface design in games , 2003, Ergonomics.

[10]  Edward S. Shapiro,et al.  Curriculum-Based Measurement and the Evaluation of Reading Skills of Spanish-Speaking English Language Learners in Bilingual Education Classrooms , 2006 .

[11]  Barbara L. Grabowski,et al.  Gameplaying for maths learning: cooperative or not? , 2007, Br. J. Educ. Technol..

[12]  R. Sawyer.  The Cambridge Handbook of the Learning Sciences: Introduction , 2014 .

[13]  Jane Sunderland,et al.  Issues of language and gender in second and foreign language education , 2000, Language Teaching.

[14]  Meng-Ping Tsuei,et al.  A web-based curriculum-based measurement system for class-wide ongoing assessment , 2007, J. Comput. Assist. Learn..

[15]  Kenton O'Hara,et al.  Gamification. using game-design elements in non-gaming contexts , 2011, CHI Extended Abstracts.

[16]  D. Hoang.  FLOW: The Psychology of Optimal Experience , 2018 .

[17]  Kursat Cagiltay,et al.  A descriptive study of Turkish high school students' game-playing characteristics and their considerations concerning the effects of games , 2008, Comput. Hum. Behav..

[18]  Amy L. Reschly,et al.  English Learners: Challenges in Assessment and the Promise of Curriculum-Based Measurement , 2011 .

[19]  Jürgen Baumert,et al.  Test motivation in the assessment of student skills: The effects of incentives on motivation and performance , 2001 .

[20]  James W. Pellegrino,et al.  Perspectives on the Integration of Technology and Assessment , 2010 .

[21]  Chien Chou,et al.  Gender differences in Taiwan high school students' computer game playing , 2007, Comput. Hum. Behav..

[22]  R. Keith Sawyer,et al.  The New Science of Learning , 2006 .

[23]  E. Farmer,et al.  Examining Predictive Validity and Rates of Growth in Curriculum-Based Measurement with English Language Learners in the Intermediate Grades. , 2013 .

[24]  Teri Wallace,et al.  Literature Synthesis on Curriculum-Based Measurement in Reading , 2007 .

[25]  Christine E. DeMars,et al.  Low Examinee Effort in Low-Stakes Assessment: Problems and Potential Solutions , 2005 .

[26]  Yukie Aida.  Examination of Horwitz, Horwitz, and Cope's Construct of Foreign Language Anxiety: The Case of Students of Japanese , 1994 .

[27]  Rena Upitis,et al.  The Story of Phoenix Quest: How girls respond to a prototype language and mathematics computer game , 1999 .

[28]  Stanley L. Deno,et al.  Developments in Curriculum-Based Measurement , 2003 .

[29]  J. McGonigal.  Reality Is Broken: Why Games Make Us Better and How They Can Change the World , 2011 .

[30]  Natalie Förster,et al.  Curriculum-Based Measurement: Developing a Computer-Based Assessment Instrument for Monitoring Student Reading Progress on Multiple Indicators. , 2011 .

[31]  C. Espin,et al.  Technical Adequacy of the Maze Task for Curriculum-Based Measurement of Reading Growth , 2000 .

[32]  R. Glaser,et al.  Knowing What Students Know: The Science and Design of Educational Assessment , 2001 .

[33]  C. Espin,et al.  Identifying Indicators of Written Expression Proficiency for Middle School Students , 2000 .

[34]  Yongqi Gu,et al.  Gender, Academic Major, and Vocabulary Learning Strategies of Chinese Efl Learners , 2002 .

[35]  Anastasios A. Economides,et al.  The acceptance and use of computer based assessment , 2011, Comput. Educ..

[36]  Christoph Klimmt,et al.  Gender and Computer Games: Exploring Females' Dislikes , 2006, J. Comput. Mediat. Commun..

[37]  Yigal Attali,et al.  Gamification in assessment: Do points affect test performance? , 2015, Comput. Educ..

[38]  Siuman Chung,et al.  CBM Progress Monitoring in Foreign Language Learning for Secondary School Students , 2013 .

[39]  Andrew K. Przybylski,et al.  The Motivational Pull of Video Games: A Self-Determination Theory Approach , 2006 .

[40]  Christine A. Espin,et al.  Reading Progress Monitoring for Secondary–School Students: Reliability, Validity, and Sensitivity to Growth of Reading–Aloud and Maze–Selection Measures , 2009 .

[41]  Jeffrey K. Smith,et al.  The Consequence of Consequence: Motivation, Anxiety, and Test Performance , 1995 .