Evaluating a tactile and a tangible multi-tablet gamified quiz system for collaborative learning in primary education

Abstract Gamification has been identified as an interesting technique to foster collaboration in educational contexts. However, there are not many approaches that tackle this in primary school learning environments. The most popular technologies in the classroom are still traditional video consoles and desktop computers, which complicate the design of collaborative activities since they are essentially mono-user. The recent popularization of handheld devices such as tablets and smartphones has made it possible to build affordable, scalable, and improvised collaborative gamified activities by creating a multi-tablet environment. In this paper we present Quizbot, a collaborative gamified quiz application to practice different subjects, which can be defined by educators beforehand. Two versions of the system are implemented: a tactile for tablets laid on a table, in which all the elements are digital; and a tangible in which the tablets are scattered on the floor and the components are both digital and physical objects. Both versions of Quizbot are evaluated and compared in a study with eighty primary-schooled children in terms of user experience and quality of collaboration supported. Results indicate that both versions of Quizbot are essentially equally fun and easy to use, and can effectively support collaboration, with the tangible version outperforming the other one with respect to make the children reach consensus after a discussion, split and parallelize work, and treat each other with more respect, but also presenting a poorer time management.

[1]  Liam J. Bannon,et al.  The motivation is the message: comparing CSCL in different settings , 2002, CSCL.

[2]  Zhijiang Dong,et al.  Engaging Computer Science Students through Gamification in an Online Social Network Based Collaborative Learning Environment , 2013 .

[3]  S. Greenberg,et al.  The Importance of Awareness for Team Cognition in Distributed Collaboration , 2001 .

[4]  Amanda Wilson,et al.  A systematic literature review of games-based learning empirical evidence in primary education , 2016, Comput. Educ..

[5]  K. Werbach,et al.  For the Win: How Game Thinking Can Revolutionize Your Business , 2012 .

[6]  Michel Leonard,et al.  Gamification-based assessment of group work , 2013, 2013 International Conference on Interactive Collaborative Learning (ICL).

[7]  Eynat Gal,et al.  To enforce or not to enforce? The use of collaborative interfaces to promote social skills in children with high functioning autism spectrum disorder , 2013, Autism : the international journal of research and practice.

[8]  Theodore Panitz The Motivational Benefits of Cooperative Learning. , 1999 .

[9]  P. Dillenbourg What do you mean by collaborative learning , 1999 .

[10]  Eva García,et al.  On the effectiveness of game-like and social approaches in learning: Comparing educational gaming, gamification & social networking , 2016, Comput. Educ..

[11]  Garry Falloon,et al.  Exploring young students' talk in iPad-supported collaborative learning environments , 2014, Comput. Educ..

[12]  Yvonne Rogers,et al.  HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration , 2014, ITS '14.

[13]  Vicente Nacher,et al.  Interactive technologies for preschool game-based instruction: Experiences and future challenges , 2016, Entertain. Comput..

[14]  T. Wagner The Global Achievement Gap: Why Even Our Best Schools Don't Teach the New Survival Skills Our Children Need--and What We Can Do About It , 2008 .

[15]  Elena Navarro,et al.  Multi-touch gestures for pre-kindergarten children , 2015, Int. J. Hum. Comput. Stud..

[16]  Janet C. Read,et al.  Validating the Fun Toolkit: an instrument for measuring children’s opinions of technology , 2008, Cognition, Technology & Work.

[17]  Laura Malinverni,et al.  The medium matters: the impact of full-body interaction on the socio-affective aspects of collaboration , 2015, IDC.

[18]  P. Tomporowski,et al.  Physical activity interventions and children's mental function: an introduction and overview. , 2011, Preventive medicine.

[19]  Christopher Harris,et al.  Meet the New School Board: Board Games Are Back--And They're Exactly What Your Curriculum Needs. , 2009 .

[20]  Tony P. Pridmore,et al.  Classroom collaboration in the design of tangible interfaces for storytelling , 2001, CHI.

[21]  Panos Markopoulos,et al.  Head Up Games: combining the best of both worlds by merging traditional and digital play , 2010, Personal and Ubiquitous Computing.

[22]  Richard J. Stiggins,et al.  An Introduction to Student-Involved Assessment for Learning , 2011 .

[23]  Jeffrey D. Karpicke,et al.  Learning with retrieval-based concept mapping. , 2014 .

[24]  Frank Klassner,et al.  Do lego mindstorms robots have a future in CS education? , 2006, SIGCSE '06.

[25]  S. Wichadee,et al.  Enhancement of Performance and Motivation through Application of Digital Games in an English Language Class. , 2018 .

[26]  Bertrand Schneider,et al.  Benefits of a Tangible Interface for Collaborative Learning and Interaction , 2011, IEEE Transactions on Learning Technologies.

[27]  Fiona Fui-Hoon Nah,et al.  Gamification of Education: A Review of Literature , 2014, HCI.

[28]  Zachary Fitz-Walter,et al.  Mystery at the library: encouraging library exploration using a pervasive mobile game , 2012, OZCHI.

[29]  Susanne Seitinger An ecological approach to children's playground props , 2006, IDC '06.

[30]  Rebeca P. Díaz Redondo,et al.  A social gamification framework for a K-6 learning platform , 2013, Comput. Hum. Behav..

[31]  Seymour Papert,et al.  Mindstorms: Children, Computers, and Powerful Ideas , 1981 .

[32]  Allison Druin,et al.  Paper vs. tablet computers: a comparative study using Tangible Flags , 2011, IDC.

[33]  Elise van den Hoven,et al.  Pipet: a design concept supporting photo sharing , 2010, NordiCHI.

[34]  Yvonne Rogers,et al.  Using 'tangibles' to promote novel forms of playful learning , 2003, Interact. Comput..

[35]  Norazah Mohd Suki,et al.  User acceptance on mobile apps as an effective medium to learn Kadazandusun language , 2016 .

[36]  Konstantin Mitgutsch,et al.  Movers and shakers: designing meaningful conflict in a tablet-based serious game , 2013, CHI Extended Abstracts.

[37]  Jesse Fox,et al.  Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance , 2015, Comput. Educ..

[38]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[39]  Dion Hoe-Lian Goh,et al.  Learning efficacy and user acceptance of a game-based social skills learning environment , 2016, Int. J. Child Comput. Interact..

[40]  B. Bederson,et al.  Designing storytelling technologies to encouraging collaboration between young children , 2000, CHI.

[41]  Burt Stillar,et al.  21st Century Learning , 2012 .

[42]  Sandra B. Fan Roles in Online Collaborative Problem Solving , 2010, 2010 IEEE Symposium on Visual Languages and Human-Centric Computing.

[43]  Paul Marshall,et al.  Do tangible interfaces enhance learning? , 2007, TEI.

[44]  Yvonne Rogers,et al.  Collaboration and interference: awareness with mice or touch input , 2008, CSCW.

[45]  Alissa Nicole Antle,et al.  Exploring how children use their hands to think: an embodied interactional analysis , 2013, Behav. Inf. Technol..

[46]  Carman Neustaedter,et al.  Exploring How a Co-dependent Tangible Tool Design Supports Collaboration in a Tabletop Activity , 2014, GROUP.

[47]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[48]  Thomas A. Brush,et al.  Embedding cooperative learning into the design of integrated learning systems: Rationale and guidelines , 1998 .

[49]  David C. Berliner,et al.  High-Stakes Testing & Student Learning , 2002 .

[50]  Jay Bal,et al.  Gamification as a tool for increasing the depth of student understanding using a collaborative e-learning environment , 2013 .

[51]  Aras Bozkurt,et al.  The Use of Gamification in Distance Education: A Web-Based Gamified Quiz Application , 2017 .

[52]  David W. Johnson,et al.  Cooperation and Competition: Theory and Research , 1989 .

[53]  Jochen Rick,et al.  Collaborative games: Lessons learned from board games , 2006 .

[54]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[55]  M. Csíkszentmihályi,et al.  Flow Theory and Research , 2009 .

[56]  Luis A. Guerrero,et al.  Kiteracy: a kit of tangible objects to strengthen literacy skills in children with down syndrome , 2015, IDC.

[57]  Jeroen Janssen,et al.  Visualization of participation: Does it contribute to successful computer-supported collaborative learning? , 2007, Comput. Educ..

[58]  Nikol Rummel,et al.  A rating scheme for assessing the quality of computer-supported collaboration processes , 2007, Int. J. Comput. Support. Collab. Learn..

[59]  Päivi Häkkinen,et al.  Instructional support in CSCL , 2004 .

[60]  Vicente Nacher,et al.  From Tabletops to Multi-Tablet Environments in Educational Scenarios: A Lightweight and Inexpensive Alternative , 2016, 2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT).

[61]  Sandra L. Calvert,et al.  Exergames for Physical Education Courses: Physical, Social, and Cognitive Benefits. , 2011, Child development perspectives.

[62]  Christopher Cheong,et al.  Quick Quiz: A Gamified Approach for Enhancing Learning , 2013, PACIS.

[63]  Jochen Rick,et al.  Proportion: a tablet app for collaborative learning , 2012, IDC '12.

[64]  E. Deci,et al.  A motivational approach to self: integration in personality. , 1990, Nebraska Symposium on Motivation. Nebraska Symposium on Motivation.

[65]  Marjan Laal,et al.  21st Century Learning; Learning in Collaboration , 2012 .

[66]  Marjan Laal,et al.  Benefits of collaborative learning , 2012 .

[67]  Selay Arkün Kocadere,et al.  The design and implementation of a gamified assessment , 2015 .

[68]  Nicole C. Krämer,et al.  To gamify or not to gamify? An experimental field study of the influence of badges on motivation, activity, and performance in an online learning course , 2018, Comput. Educ..

[69]  Martin Kraus,et al.  Tangible Widgets for a Multiplayer Tablet Game in Comparison to Finger Touch , 2015, CHI PLAY.

[70]  Vincent Aleven,et al.  Toward a Framework for the Analysis and Design of Educational Games , 2010, 2010 Third IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning.

[71]  Fabio Pianesi,et al.  Collaborative Puzzle Game: a tabletop interactive game for fostering collaboration in children with Autism Spectrum Disorders (ASD) , 2009, ITS '09.

[72]  David J. Shernoff,et al.  Student engagement in high school classrooms from the perspective of flow theory. , 2003 .

[73]  Daniela Caballero,et al.  Collaboration within large groups in the classroom , 2011, Int. J. Comput. Support. Collab. Learn..

[74]  Timo Lainema,et al.  Flow framework for analyzing the quality of educational games , 2014, Entertain. Comput..

[75]  Haichun Sun,et al.  Exergaming Impact on Physical Activity and Interest in Elementary School Children , 2012, Research quarterly for exercise and sport.

[76]  C S Green,et al.  Video games as a tool to train visual skills. , 2008, Restorative neurology and neuroscience.

[77]  Deirdre Butler,et al.  Design, story-telling, and robots in Irish primary education , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[78]  Ronald D. Zellner,et al.  The relative effects of positive interdependence and group processing on student achievement and attitude in online cooperative learning , 2011, Comput. Educ..

[79]  Luis de Marcos,et al.  Gamifying learning experiences: Practical implications and outcomes , 2013, Comput. Educ..

[80]  Jane Westergaard Effective group work with young people , 2009 .

[81]  Yuki Tanaka,et al.  Effects of Gamified Quiz to Student's Motivation and Score , 2016, 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES).

[82]  C. Tsihouridis,et al.  Assessing the Learning Process Playing with Kahoot - A Study with Upper Secondary School Pupils Learning Electrical Circuits , 2017, ICL.

[83]  C. Tsihouridis,et al.  “Let’s Go… Kahooting” – Teachers’ Views on C.R.S. for Teaching Purposes , 2017 .

[84]  Karl M. Kapp,et al.  A Gamified Approach on Learning Logic Gates to Improve Student’s Engagement , 2012, IOP Conference Series: Materials Science and Engineering.

[85]  Elena Navarro,et al.  Improving Pre-Kindergarten Touch Performance , 2014, ITS '14.

[86]  Noah S. Podolefsky,et al.  When learning about the real world is better done virtually: A study of substituting computer simulations for laboratory equipment , 2005 .

[87]  Jeffrey Earp,et al.  An update to the systematic literature review of empirical evidence of the impacts and outcomes of computer games and serious games , 2016, Comput. Educ..

[88]  David W. Johnson,et al.  Making cooperative learning work , 1999 .

[89]  Vicente Nacher,et al.  Toward a General Conceptualization of Multi-Display Environments , 2016, Front. ICT.

[90]  Fernando Garcia-Sanjuan,et al.  TangiWheel: A Widget for Manipulating Collections on Tabletop Displays Supporting Hybrid Input Modality , 2012, Journal of Computer Science and Technology.

[91]  Liang-Yi Li,et al.  Researches on Using Robots in Education , 2009, Edutainment.

[92]  Alyssa Friend Wise,et al.  Getting Down to Details: Using Theories of Cognition and Learning to Inform Tangible User Interface Design , 2013, Interact. Comput..

[93]  Philip Tuddenham,et al.  Graspables revisited: multi-touch vs. tangible input for tabletop displays in acquisition and manipulation tasks , 2010, CHI.

[94]  Alissa Nicole Antle,et al.  Are tangibles more fun?: comparing children's enjoyment and engagement using physical, graphical and tangible user interfaces , 2008, TEI.

[95]  Christopher Cheong,et al.  Using Design Science Research to Incorporate Gamification into Learning Activities , 2013, PACIS.

[96]  Allison Druin,et al.  Child's play: a comparison of desktop and physical interactive environments , 2005, IDC '05.

[97]  Vicente Nacher,et al.  Evaluating the Usability of a Tangible-Mediated Robot for Kindergarten Children Instruction , 2016, 2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT).

[98]  Fernando Garcia-Sanjuan,et al.  Agoras: Towards Collaborative Game-Based Learning Experiences on Surfaces , 2012, CELDA 2012.

[99]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[100]  Carl Gutwin,et al.  A Descriptive Framework of Workspace Awareness for Real-Time Groupware , 2002, Computer Supported Cooperative Work (CSCW).

[101]  Touraj Khodadadi,et al.  The Effective Factors on User Acceptance in Mobile Business Intelligence , 2014 .

[102]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[103]  Michael Rohs,et al.  BYOD: bring your own device , 2004 .

[104]  Catherine J. Stevens,et al.  A review of the applicability of robots in education , 2013 .

[105]  R. Slavin Research on cooperative learning and achievement: What we know, what we need to know. , 1996 .

[106]  Sadhana Puntambekar,et al.  The effects of physical and virtual manipulatives on students' conceptual learning about pulleys , 2010, ICLS.

[107]  Stuart MacFarlane,et al.  Using the fun toolkit and other survey methods to gather opinions in child computer interaction , 2006, IDC '06.

[108]  Marina Umaschi Bers,et al.  “I want my robot to look for food”: Comparing Kindergartner’s programming comprehension using tangible, graphic, and hybrid user interfaces , 2015 .

[109]  Seiji Isotani,et al.  A systematic mapping on gamification applied to education , 2014, SAC.

[110]  Jeffrey Earp,et al.  Learning through Playing for or against Each Other? Promoting Collaborative Learning in Digital Game Based Learning , 2012, ECIS.

[111]  Vicente Nacher,et al.  Tangibot: A tangible-mediated robot to support cognitive games for ageing people - A usability study , 2017, Pervasive Mob. Comput..

[112]  Paul Marshall,et al.  Beyond one-size-fits-all: how interactive tabletops support collaborative learning , 2011, IDC.

[113]  Carl Gutwin,et al.  Effects of awareness support on groupware usability , 1998, CHI.

[114]  G. Olympiou,et al.  Physical versus Virtual Manipulative Experimentation in Physics Learning. , 2011 .