Addressing Global Challenges and Quality Education: 15th European Conference on Technology Enhanced Learning, EC-TEL 2020, Heidelberg, Germany, September 14–18, 2020, Proceedings

Many educational texts lack comprehension questions and authoring them consumes time and money. Thus, in this article, we ask ourselves to what extent artificial jabbering text generation systems can be used to generate textbook comprehension questions. Novel machine learning-based text generation systems jabber on a wide variety of topics with deceptively good performance. To expose the generated texts as such, one often has to understand the actual topic the systems jabbers about. Hence, confronting learners with generated texts may cause them to question their level of knowledge. We built a novel prototype that generates comprehension questions given arbitrary textbook passages. We discuss the strengths and weaknesses of the prototype quantitatively and qualitatively. While our prototype is not perfect, we provide evidence that such systems have great potential as question generators and identify the most promising starting points may leading to (semi) automated generators that support textbook authors and self-studying.

[1]  Chin-Chung Tsai,et al.  Students' views of the nature of science: A critical review of research , 2011 .

[2]  Susan Bull,et al.  There are Open Learner Models About! , 2020, IEEE Transactions on Learning Technologies.

[3]  Dirk Ifenthaler,et al.  Student perceptions of privacy principles for learning analytics , 2016, Educational Technology Research and Development.

[4]  Udo Lindemann,et al.  Cross-Cultural User Experience Design Helping Product Designers to Consider Cultural Differences , 2015, HCI.

[5]  Kate Thompson,et al.  Theory-led Design of Instruments and Representations in Learning Analytics: Developing a Novel Tool for Orchestration of Online Collaborative Learning , 2015, J. Learn. Anal..

[6]  Rada Mihalcea,et al.  Learning to Grade Short Answer Questions using Semantic Similarity Measures and Dependency Graph Alignments , 2011, ACL.

[7]  Paul Drijvers Digital assessment of mathematics: Opportunities, issues and criteria , 2019, Mesure et évaluation en éducation.

[8]  Paulo Carvalho,et al.  Comprehension Factor Analysis: Modeling student's reading behaviour: Accounting for reading practice in predicting students' learning in MOOCs , 2019, LAK.

[9]  Tim Unwin,et al.  The Future Use of Technology in Education and Learning in the Commonwealth , 2019, The Round Table.

[10]  Li Min Li,et al.  Hackathon as a way to raise awareness and foster innovation for stroke. , 2015, Arquivos de neuro-psiquiatria.

[11]  Tom Murray,et al.  An Overview of Intelligent Tutoring System Authoring Tools: Updated Analysis of the State of the Art , 2003 .

[12]  Michael Kerres,et al.  A Didactical Framework for the Design of Blended Learning Arrangements , 2003 .

[13]  Chanle Wu,et al.  A New Intelligent Topic Extraction Model on Web , 2011, J. Comput..

[14]  Francesco Mondada,et al.  Improved Mobile Robot Programming Performance through Real-time Program Assessment , 2017, ITiCSE.

[15]  Tzone-I Wang,et al.  Construction and analysis of educational assessments using knowledge maps with weight appraisal of concepts , 2010, Comput. Educ..

[16]  Randy L. Bell,et al.  Views of nature of science questionnaire: Toward valid and meaningful assessment of learners' conceptions of nature of science , 2002 .

[17]  Scott R. Klemmer,et al.  Juxtapeer: Comparative Peer Review Yields Higher Quality Feedback and Promotes Deeper Reflection , 2018, CHI.

[18]  T. C. Nicholas Graham,et al.  Designing action-based exergames for children with cerebral palsy , 2013, CHI.

[19]  Iris Braun,et al.  Technology-Enhanced Self-Regulated Learning: Assessment Support Through an Evaluation Centre , 2018, 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC).

[20]  Eileen Scanlon,et al.  Inquiry learning at scale: pedagogy-informed design of a platform for citizen inquiry , 2019, L@S.

[21]  Zhenyu Yang,et al.  A Study on Self-efficacy and Its Role in Mobile-assisted Language Learning , 2020 .

[22]  Jessica Hammer,et al.  CHI 2018 Workshop: Data-Driven Educational Game Design , 2018, CHI Extended Abstracts.

[23]  Abdulhadi Shoufan,et al.  A Web-Based Visualization and Animation Platform for Digital Logic Design , 2015, IEEE Transactions on Learning Technologies.

[24]  Gregory J. Cizek,et al.  Sources of Validity Evidence for Educational and Psychological Tests: A Follow-Up Study , 2010 .

[25]  Alex Bateman,et al.  An introduction to hidden Markov models. , 2007, Current protocols in bioinformatics.

[26]  D. T. Lee,et al.  GeoBuilder: A Geometric Algorithm Visualization and Debugging System for 2D and 3D Geometric Computing , 2009, IEEE Transactions on Visualization and Computer Graphics.

[27]  Mohamed Amine Chatti,et al.  The PERLA Framework: Blending Personalization and Learning Analytics , 2019, The International Review of Research in Open and Distributed Learning.

[28]  Kenneth R. Koedinger,et al.  Adaptive Intelligent Support to Improve Peer Tutoring in Algebra , 2013, International Journal of Artificial Intelligence in Education.

[29]  Patrick Jermann,et al.  TinkerLamp 2.0: Designing and Evaluating Orchestration Technologies for the Classroom , 2012, EC-TEL.

[30]  David Gibson,et al.  Evolving Learning Paradigms: Re-Setting Baselines and Collection Methods of Information and Communication Technology in Education Statistics , 2018, J. Educ. Technol. Soc..

[31]  Tonguc Utku Yilmaz,et al.  Importance of education in organ donation. , 2011, Experimental and clinical transplantation : official journal of the Middle East Society for Organ Transplantation.

[32]  Dragan Gasevic,et al.  A Multivariate ELO-based Learner Model for Adaptive Educational Systems , 2019, EDM.

[33]  L. Festinger A Theory of Social Comparison Processes , 1954 .

[34]  Eugenijus Kurilovas,et al.  Methodology for Evaluating Quality and Reusability of Learning Objects. , 2011 .

[35]  Wei Wang,et al.  Learning portfolio analysis and mining in SCORM compliant environment , 2004, 34th Annual Frontiers in Education, 2004. FIE 2004..

[36]  Stéphane Natkin,et al.  Scaling the Level of Difficulty in Single Player Video Games , 2009, ICEC.

[37]  Dietmar Jannach,et al.  Sequence-Aware Recommender Systems , 2018, UMAP.

[38]  Valerie J. Shute,et al.  The interplay of game elements with psychometric qualities, learning, and enjoyment in game-based assessment , 2015, Comput. Educ..

[39]  Erik Duval,et al.  Learning Analytics Dashboard Applications , 2013 .

[40]  Peter Brusilovsky,et al.  Social Adaptive Navigation Support for Open Corpus Electronic Textbooks , 2004, AH.

[41]  Haoran Xie,et al.  Discover learning path for group users: A profile-based approach , 2017, Neurocomputing.

[42]  Michael J Ackerman,et al.  Transient QT interval prolongation in an infant with Simpson–Golabi–Behmel syndrome , 2010, American journal of medical genetics. Part A.

[43]  Curtis J. Bonk,et al.  Motivations, Achievements, and Challenges of Self-Directed Informal Learners in Open Educational Environments and MOOCs , 2017, Journal of Learning for Development.

[44]  Linda Corrin,et al.  A conceptual framework linking learning design with learning analytics , 2016, LAK.

[45]  Jon Mason,et al.  Are They Thinking Differently: A Cross-Cultural Study on the Relationship of Thinking Styles and Emerging Roles in Computer-Supported Collaborative Learning , 2017, J. Educ. Technol. Soc..

[46]  Kenneth R. Koedinger,et al.  A Data Repository for the EDM Community: The PSLC DataShop , 2010 .

[47]  Robert Sedgewick,et al.  A system for algorithm animation , 1984, SIGGRAPH.

[48]  D. Ariely,et al.  Procrastination, Deadlines, and Performance: Self-Control by Precommitment , 2002, Psychological science.

[49]  Thomas L. Naps,et al.  A testbed for pedagogical requirements in algorithm visualizations , 2002, ITiCSE '02.

[50]  Maren Scheffel,et al.  From students with love: An empirical study on learner goals, self-regulated learning and sense-making of learning analytics in higher education , 2020, Internet High. Educ..

[51]  Sanjay Krishnan,et al.  A methodology for learning, analyzing, and mitigating social influence bias in recommender systems , 2014, RecSys '14.

[52]  Bernhard Wolf,et al.  Implementing Gamification: Requirements and Gamification Platforms , 2015 .

[53]  Arun G. Chandrasekhar,et al.  The Diffusion of Microfinance , 2012, Science.

[54]  Nikol Rummel,et al.  Are two heads always better than one? Differential effects of collaboration on students’ computer-supported learning in mathematics , 2011, Int. J. Comput. Support. Collab. Learn..

[55]  Ulrik Schroeder,et al.  Informatik Grundbildung im Alter - Ein eLearning Konzept , 2019, DeLFI.

[56]  Leo Katz,et al.  A new status index derived from sociometric analysis , 1953 .

[57]  Alpár István Vita Vörös,et al.  Physics escape room as an educational tool , 2017 .

[58]  William A. Sandoval,et al.  Educational Design Research in the 21st Century , 2013 .

[59]  J. Stuart,et al.  MEDICAL STUDENT CONCENTRATION DURING LECTURES , 1978, The Lancet.

[60]  Zoran Budimac,et al.  Applying Recommender Systems and Adaptive Hypermedia for e-Learning Personalizatio , 2013, Comput. Informatics.

[61]  Bo An,et al.  Optimal Spot-Checking for Improving Evaluation Accuracy of Peer Grading Systems , 2018, AAAI.

[62]  Manuel Santos-Trigo,et al.  Mathematical Problem Solving , 2015 .

[63]  P. Pintrich,et al.  The Development of Epistemological Theories: Beliefs About Knowledge and Knowing and Their Relation to Learning , 1997 .

[64]  Dragomir R. Radev,et al.  TutorialBank: A Manually-Collected Corpus for Prerequisite Chains, Survey Extraction and Resource Recommendation , 2018, ACL.

[65]  Carolyn Penstein Rosé,et al.  Enhancing Scientific Reasoning and Discussion with Conversational Agents , 2013, IEEE Transactions on Learning Technologies.

[66]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[67]  Robert Plutchik,et al.  A psychoevolutionary theory of emotions , 1982 .

[68]  Jerry Li,et al.  Web-Based Tools for Learning Object Evaluation , 2004 .

[69]  Lauri Malmi,et al.  MatrixPro - A Tool for On-The-Fly Demonstration of Data Structures and Algorithms , 2004 .

[70]  J. Gee,et al.  Video Games and the Future of Learning , 2005 .

[71]  Katrien Verbert,et al.  Review of Research on Student-Facing Learning Analytics Dashboards and Educational Recommender Systems , 2017, IEEE Transactions on Learning Technologies.

[72]  Steven Lonn,et al.  Perceptions and use of an early warning system during a higher education transition program , 2014, LAK.

[73]  Vincent Aleven,et al.  Intelligent tutors as teachers' aides: exploring teacher needs for real-time analytics in blended classrooms , 2017, LAK.

[74]  K. R. Kelly,et al.  Comparison of the Effectiveness of Two Assessment Feedback Models in Reducing Career Indecision , 2013 .

[75]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[76]  Peter Beighton,et al.  A clinical and molecular investigation of two South African families with Simpson-Golabi-Behmel syndrome. , 2016, South African medical journal = Suid-Afrikaanse tydskrif vir geneeskunde.

[77]  Fabio Crestani,et al.  Appearance and functionality of electronic books , 2004, International Journal on Digital Libraries.

[78]  Rosemary Luckin Enhancing Learning and Teaching with Technology: What the research says , 2018 .

[79]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[80]  Florence Martin,et al.  Using Learning Analytics to Enhance Student Learning in Online Courses Based on Quality Matters Standards , 2016 .

[81]  Karina Caro Corrales FroggyBobby: An exergame to support children with motor problems practicing motor coordination exercises during therapeutic interventions , 2017 .

[82]  Vincent Aleven,et al.  Enhancing learning outcomes through self-regulated learning support with an Open Learner Model , 2017, User Modeling and User-Adapted Interaction.

[83]  Ying Xu,et al.  Participatory data collection and management in low-resource contexts: a field trial with urban refugees , 2019, ICTD.

[84]  Ashish Sureka,et al.  Process mining software repositories from student projects in an undergraduate software engineering course , 2014, ICSE Companion.

[85]  J. Ángel Velázquez-Iturbide,et al.  GreedEx: A Visualization Tool for Experimentation and Discovery Learning of Greedy Algorithms , 2013, IEEE Transactions on Learning Technologies.

[86]  Paulo Blikstein,et al.  Using learning analytics to assess students' behavior in open-ended programming tasks , 2011, LAK.

[87]  Katrien Verbert,et al.  Linking learning behavior analytics and learning science concepts: Designing a learning analytics dashboard for feedback to support learning regulation , 2020, Comput. Hum. Behav..

[88]  Mollie Dollinger,et al.  Co-creation strategies for learning analytics , 2018, LAK.

[89]  Hille Janhonen-Abruquah,et al.  North–South–South collaboration as a context for collaborative learning and thinking with alternative knowledges , 2019 .

[90]  Judy Kay,et al.  MTClassroom and MTDashboard: Supporting Analysis of Teacher Attention in an Orchestrated Multi-Tabletop Classroom , 2013, CSCL.

[91]  Richard E. Mayer,et al.  Thirty years of research on online learning , 2018, Applied Cognitive Psychology.

[92]  Anouschka van Leeuwen,et al.  What information should CSCL teacher dashboards provide to help teachers interpret CSCL situations? , 2019, Int. J. Comput. Support. Collab. Learn..

[93]  Sanna Järvelä,et al.  Affective Learning in Digital Education—Case Studies of Social Networking Systems, Games for Learning, and Digital Fabrication , 2019, Front. Educ..

[94]  Michelle Taub,et al.  Self-Regulation in Computer-Assisted Learning Systems , 2019, The Cambridge Handbook of Cognition and Education.

[95]  Michael Prilla,et al.  Understanding and Supporting Reflective Learning Processes in the Workplace: The CSRL Model , 2013, EC-TEL.

[96]  Begoña Gros The design of smart educational environments , 2016, Smart Learning Environments.

[97]  Vincent Aleven,et al.  Student Learning Benefits of a Mixed-Reality Teacher Awareness Tool in AI-Enhanced Classrooms , 2018, AIED.

[98]  Ebba Ossiannilsson,et al.  Learning analytics in theory and practice: Guest editorial , 2019, The International Journal of Information and Learning Technology.

[99]  Andreas Hepp,et al.  Die Komplexität der Datafizierung: zur Herausforderung, digitale Spuren in ihrem Kontext zu analysieren , 2018 .

[100]  Jun Wang,et al.  Topic-Specific Recommendation for Open Education Resources , 2015, ICWL.

[101]  David Moher,et al.  Evidence summaries: the evolution of a rapid review approach , 2012, Systematic Reviews.

[102]  C. Hassall,et al.  Institutional and technological barriers to the use of open educational resources (OERs) in physiology and medical education. , 2017, Advances in physiology education.

[103]  Fred Paas,et al.  The Association between Motivation, Affect, and Self-regulated Learning When Solving Problems , 2017, Front. Psychol..

[104]  Dragan Gasevic,et al.  Exploring students' sensemaking of learning analytics dashboards: Does frame of reference make a difference? , 2019, LAK.

[105]  Paul N. Bennett,et al.  Pairwise ranking aggregation in a crowdsourced setting , 2013, WSDM.

[106]  Michael Ian Shamos,et al.  Computational geometry: an introduction , 1985 .

[107]  Jesper Juul Fear of Failing ? The Many Meanings of Difficulty in Video Games , 2011 .

[108]  L. Wheeler,et al.  The Proxy Model of Social Comparison for Self-Assessment of Ability , 1997, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[109]  Xia Feng,et al.  Latent Dirichlet allocation (LDA) and topic modeling: models, applications, a survey , 2017, Multimedia Tools and Applications.

[110]  Anna Filighera,et al.  Fooling Automatic Short Answer Grading Systems , 2020, AIED.

[111]  Gopal Naik,et al.  Impact of use of technology on student learning outcomes: Evidence from a large-scale experiment in India , 2020, World Development.

[112]  D. Norman The Design of Everyday Things: Revised and Expanded Edition , 2013 .

[113]  Pedro Ponce,et al.  Experiences in interactive collaborative learning using an open innovation laboratory: The design methodologies course as case study , 2017, 2017 International Conference on Engineering, Technology and Innovation (ICE/ITMC).

[114]  Yoon Jung Kim The Effects of Mobile-Assisted Language Learning (MALL) on Korean College Students’ English-Listening Performance and English-Listening Anxiety , 2018 .

[115]  Katrien Verbert,et al.  Multi-institutional positioning test feedback dashboard for aspiring students: lessons learnt from a case study in flanders , 2018, LAK.

[116]  Birgitta König-Ries,et al.  Progressor: social navigation support through open social student modeling , 2013, New Rev. Hypermedia Multim..

[117]  Brock Craft,et al.  Learning Design: Reflections upon the Current Landscape , 2012 .

[118]  Agnes Kukulska-Hulme,et al.  The next generation: design and the infrastructure for learning in a mobile and networked world , 2011 .

[119]  Laura Gibson Student-Directed Learning: An Exercise in Student Engagement , 2011 .

[120]  Allison Druin,et al.  Technology probes: inspiring design for and with families , 2003, CHI '03.

[121]  Ulrik Schroeder,et al.  The Goal - Question - Indicator Approach for Personalized Learning Analytics - , 2017, CSEDU.

[122]  Mike Sharples,et al.  Shared orchestration within and beyond the classroom , 2013, Comput. Educ..

[123]  A. P. Rovai In search of higher persistence rates in distance education online programs , 2003, Internet High. Educ..

[124]  Phu Vu,et al.  Aware, But Don't Really Care: Students' Perspective on Privacy and Data Collection in Online Courses , 2020 .

[125]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[126]  Kenneth King,et al.  Lost in translation? The challenge of translating the global education goal and targets into global indicators , 2017 .

[127]  Olga Viberg,et al.  Disseminating digital, science-based innovation in education : a leadership challenge , 2020 .

[128]  Alexander Schill,et al.  stARS: Proposing an Adaptable Collaborative Learning Environment to Support Communication in the Classroom , 2020, CSEDU.

[129]  Lauri Malmi,et al.  Visual Algorithm Simulation Exercise System with Automatic Assessment: TRAKLA2 , 2004, Informatics Educ..

[130]  Eduardo Gómez-Sánchez,et al.  Towards the Enactment of Learning Situations Connecting Formal and Non-Formal Learning in SLEs , 2019 .

[131]  Marc H. Brown,et al.  Exploring algorithms using Balsa-II , 1988, Computer.

[132]  Eduardo Gómez-Sánchez,et al.  The Potential of Open Data to Automatically Create Learning Resources for Smart Learning Environments , 2019, UCAmI.

[133]  Jerry Suls,et al.  Social Comparison: Why, With Whom, and With What Effect? , 2002 .

[134]  Benoît Bossavit,et al.  MotorSense: Using Motion Tracking Technology to Support the Identification and Treatment of Gross-Motor Dysfunction , 2017, AAATE Conf..

[135]  H. Lee Swanson,et al.  Instructing Adolescents with Learning Disabilities: A Component and Composite Analysis , 2001 .

[136]  Melanie Peffer,et al.  Assessing epistemological beliefs of experts and novices via practices in authentic science inquiry , 2019, International Journal of STEM Education.

[137]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[138]  Welf Löwe,et al.  Online-configuration of software visualizations with Vizz3D , 2005, SoftVis '05.

[139]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[140]  Karen Littleton,et al.  Epistemology, Assessment, Pedagogy: Where Learning Meets Analytics in the Middle Space , 2014, J. Learn. Anal..

[141]  Kenneth R. Koedinger,et al.  Using Problem-Solving Context to Assess Help Quality in Computer-Mediated Peer Tutoring , 2010, Intelligent Tutoring Systems.

[142]  Fabio Stella,et al.  Contrasting Offline and Online Results when Evaluating Recommendation Algorithms , 2016, RecSys.

[143]  Dragan Gasevic,et al.  How Do We Start? State Directions of Learning Analytics Adoption , 2016 .

[144]  David P. Dobkin,et al.  Visualization of Geometric Algorithms , 1995, IEEE Trans. Vis. Comput. Graph..

[145]  Yves Punie,et al.  Promoting Effective Digital-Age Learning - A European Framework for Digitally-Competent Educational Organisations , 2015 .

[146]  Eyal Shnarch,et al.  Are You Convinced? Choosing the More Convincing Evidence with a Siamese Network , 2019, ACL.

[147]  Paul Denny,et al.  The effect of virtual achievements on student engagement , 2013, CHI.

[148]  Chung-Ho Su,et al.  Designing and Developing a Novel Hybrid Adaptive Learning Path Recommendation System (ALPRS) for Gamification Mathematics Geometry Course , 2017 .

[149]  Davinia Hernández Leo,et al.  Towards teaching as design: Exploring the interplay between full-lifecycle learning design tooling and Teacher Professional Development , 2017, Comput. Educ..

[150]  A. Elliot,et al.  A HIERARCHICAL MODEL OF APPROACH AND AVOIDANCE ACHIEVEMENT MOTIVATION , 1997 .

[151]  Bernice Elger,et al.  The inconsistent ethical oversight of healthcare quality data in Switzerland. , 2018, Swiss medical weekly.

[152]  Brock Craft,et al.  Editorial: The art and science of learning design , 2013 .

[153]  Vincent Aleven,et al.  Instruction Based on Adaptive Learning Technologies , 2016 .

[154]  Rory McGreal,et al.  Special Report on the Role of Open Educational Resources in Supporting the Sustainable Development Goal 4: Quality Education Challenges and Opportunities , 2017 .

[155]  Erik Duval,et al.  The student activity meter for awareness and self-reflection , 2012, CHI Extended Abstracts.

[156]  M. Clarke,et al.  Increasing response rates to postal questionnaires: systematic review , 2002, BMJ : British Medical Journal.

[157]  Sandra Gama,et al.  Adaptive learning path recommender approach using auxiliary learning objects , 2020, Comput. Educ..

[158]  James D. Slotta,et al.  Supporting classroom orchestration with real-time feedback: A role for teacher dashboards and real-time agents , 2019, International Journal of Computer-Supported Collaborative Learning.

[159]  Neil T. Heffernan,et al.  AXIS: Generating Explanations at Scale with Learnersourcing and Machine Learning , 2016, L@S.

[160]  Paul Zarchan,et al.  Fundamentals of Kalman Filtering: A Practical Approach , 2001 .

[161]  김 선진,et al.  운동발달의 이해 = Understanding motor development , 2003 .

[162]  Jesús M. González-Barahona,et al.  Mining student repositories to gain learning analytics. An experience report , 2013, 2013 IEEE Global Engineering Education Conference (EDUCON).

[163]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[164]  Katrien Verbert,et al.  Learning Analytics Dashboards to Support Adviser-Student Dialogue , 2018, IEEE Transactions on Learning Technologies.

[165]  B. Zimmerman Self-Regulated Learning and Academic Achievement: An Overview , 1990 .

[166]  Reinhard Pekrun,et al.  Emotion Transmission in the Classroom Revisited: A Reciprocal Effects Model of Teacher and Student Enjoyment , 2017, Journal of Educational Psychology.

[167]  Erik Duval,et al.  Visualizing Activities for Self-reflection and Awareness , 2010, ICWL.

[168]  Lei Shi,et al.  Learners Thrive Using Multifaceted Open Social Learner Modeling , 2016, IEEE MultiMedia.

[169]  Nicolai Winther-Nielsen,et al.  Remote but Connected: Ownership-Inspired Behavior-Driven Development and What an E-Learning Governance System for Africa Could Look like , 2018 .

[170]  Pierre Dillenbourg,et al.  Technology for Classroom Orchestration , 2010 .

[171]  José Paulo Leal,et al.  Long Term Goal Oriented Recommender Systems , 2015, WEBIST.

[172]  Kevin Leyton-Brown,et al.  Mechanical TA: Partially Automated High-Stakes Peer Grading , 2015, SIGCSE.

[173]  Theodore J. Kopcha,et al.  Conducting educational design research , 2013 .

[174]  Ralf Steinmetz,et al.  Automatic creation of exercises in adaptive hypermedia learning systems , 2000, HYPERTEXT '00.

[175]  Chris Beaumont,et al.  Easing the transition from school to HE: scaffolding the development of self-regulated learning through a dialogic approach to feedback , 2016 .

[176]  David A. Bergin,et al.  Influences on classroom interest , 1999 .

[177]  Nikol Rummel,et al.  Orchestration tools to support the teacher during student collaboration: a review , 2019, Unterrichtswissenschaft.

[178]  Mahmoud Abdulwahed,et al.  Orchestrating technology enhanced learning: a literature review and a conceptual framework , 2011 .

[179]  G. Neri,et al.  Clinical and molecular aspects of the Simpson-Golabi-Behmel syndrome. , 1998, American journal of medical genetics.

[180]  Bart Rienties,et al.  Linking students' timing of engagement to learning design and academic performance , 2018, LAK.

[181]  Qinghua Zheng,et al.  A multi-constraint learning path recommendation algorithm based on knowledge map , 2017, Knowl. Based Syst..

[182]  Lauri Malmi,et al.  An integrated practice system for learning programming in Python: design and evaluation , 2018, Research and Practice in Technology Enhanced Learning.

[183]  Marcia D. Dixson Measuring Student Engagement in the Online Course: The Online Student Engagement Scale (OSE). , 2015 .

[184]  Antonio Pietrosanto,et al.  Chatbot for e-learning: A case of study , 2018 .

[185]  Arun G. Chandrasekhar,et al.  Using Gossips to Spread Information: Theory and Evidence from Two Randomized Controlled Trials , 2017, The Review of Economic Studies.

[186]  Luc Trouche,et al.  Re-sourcing teachers’ work and interactions: a collective perspective on resources, their use and transformation , 2013 .

[187]  Carolyn Penstein Rosé,et al.  UpGrade: Sourcing Student Open-Ended Solutions to Create Scalable Learning Opportunities , 2019, L@S.

[188]  Per B. Brockhoff,et al.  lmerTest Package: Tests in Linear Mixed Effects Models , 2017 .

[189]  Haiyi Zhu,et al.  Towards Value-Sensitive Learning Analytics Design , 2018, LAK.

[190]  Kris Stutchbury,et al.  Mediated Authentic Video: A Flexible Tool Supporting a Developmental Approach to Teacher Education , 2017 .

[191]  Klaus Obermayer,et al.  Support vector learning for ordinal regression , 1999 .

[192]  Guoliang Li,et al.  Truth Inference in Crowdsourcing: Is the Problem Solved? , 2017, Proc. VLDB Endow..

[193]  Rupert G. Miller The jackknife-a review , 1974 .

[194]  Judy Kay,et al.  The LATUX workflow: designing and deploying awareness tools in technology-enabled learning settings , 2015, LAK.

[195]  Jessica Sandland,et al.  The Influence of Immediate Homework Feedback on Student Performance and Satisfaction in an Engineering MOOC , 2018, 2018 Learning With MOOCS (LWMOOCS).

[196]  J. Ángel Velázquez-Iturbide,et al.  GreedExCol, A CSCL tool for experimenting with greedy algorithms , 2015, Comput. Appl. Eng. Educ..

[197]  Julita Vassileva,et al.  Motivating Cooperation on Peer to Peer Networks , 2003, User Modeling.

[198]  L. Woolfson,et al.  An investigation of factors impacting on mainstream teachers’ beliefs about teaching students with learning difficulties , 2009 .

[199]  Martijn Millecamp,et al.  A qualitative evaluation of a learning dashboard to support advisor-student dialogues , 2018, LAK.

[200]  B. Buunk,et al.  Individual differences in social comparison: development of a scale of social comparison orientation. , 1999, Journal of personality and social psychology.

[201]  Mercedes Echevarria,et al.  Developmental Surveillance and Screening Practices by Pediatric Primary Care Providers: Implications for Early Intervention Professionals , 2016 .

[202]  Clifford A. Shaffer,et al.  Creating Engaging Online Learning Material with the JSAV JavaScript Algorithm Visualization Library , 2016, IEEE Transactions on Learning Technologies.

[203]  Norman G. Lederman,et al.  Meaningful assessment of learners' understandings about scientific inquiry—The views about scientific inquiry (VASI) questionnaire , 2014 .

[204]  Tristan Denley,et al.  How Predictive Analytics and Choice Architecture Can Improve Student Success. , 2014 .

[205]  Fred Paas,et al.  Self-Explaining Steps in Problem-Solving Tasks to Improve Self-Regulation in Secondary Education , 2017 .

[206]  Ryan Shaun Joazeiro de Baker,et al.  Stupid Tutoring Systems, Intelligent Humans , 2016, International Journal of Artificial Intelligence in Education.

[207]  Jan Smeddinck,et al.  Personalized and Adaptive Serious Games , 2015, Entertainment Computing and Serious Games.

[208]  Geert-Jan Houben,et al.  Follow the successful crowd: raising MOOC completion rates through social comparison at scale , 2017, LAK.

[209]  Mijna Hadders-Algra,et al.  Motor development in infancy is related to cognitive function at 4 years of age , 2018, Developmental medicine and child neurology.

[210]  Rachel Lambert,et al.  “My Dyslexia is Like a Bubble”: How Insiders with Learning Disabilities Describe Their Differences, Strengths, and Challenges , 2019, Learning Disabilities: A Multidisciplinary Journal.

[211]  Chris North,et al.  Toward measuring visualization insight , 2006, IEEE Computer Graphics and Applications.

[212]  Alicia C. Dowd,et al.  Effective Advising: How Academic Advising Influences Student Learning Outcomes in Different Institutional Contexts , 2019, The Review of Higher Education.

[213]  Steve Joordens,et al.  Peering into large lectures: examining peer and expert mark agreement using peerScholar, an online peer assessment tool , 2008, J. Comput. Assist. Learn..

[214]  Vincent Aleven,et al.  Co-Designing a Real-Time Classroom Orchestration Tool to Support Teacher-AI Complementarity , 2019, J. Learn. Anal..

[215]  Behnam Rahdari Using Knowledge Graph for Explainable Recommendation of External Content in Electronic Textbooks , 2020, iTextbooks@AIED.

[216]  Matthias Peissner,et al.  Voice User Interface Design , 2004, UP.

[217]  Peter Brusilovsky,et al.  Reading Mirror: Social Navigation and Social Comparison for Electronic Textbooks , 2019, iTextbooks@AIED.

[218]  Neven A. M. El Sayed Applying Augmented Reality Techniques in the Field of Education: "ARSC: Augmented Reality Student Card" An Augmented Reality Solution for The Education Field , 2011 .

[219]  Ryan S. Baker,et al.  Serious Games Analytics to Measure Implicit Science Learning , 2015 .

[220]  Jonathan E. Butner,et al.  Compliance with a Request in Two Cultures: The Differential Influence of Social Proof and Commitment/Consistency on Collectivists and Individualists , 1999 .

[221]  Chris Quintana,et al.  Keeping Watch: Exploring Wearable Technology Designs for K-12 Teachers , 2016, CHI Extended Abstracts.

[222]  D. Nicol Assessment for learner self‐regulation: enhancing achievement in the first year using learning technologies , 2009 .

[223]  Olga Viberg,et al.  Self-regulated learning and learning analytics in online learning environments: a review of empirical research , 2020, LAK.

[224]  Kit‐ling Lau,et al.  Possibilities and Challenges of Implementing Self-Regulatory Instruction in Hong Kong Chinese Language Classes , 2014 .

[225]  David C. Parkes,et al.  Practical Peer Prediction for Peer Assessment , 2016, HCOMP.

[226]  J. Broadbent,et al.  Self-regulated learning strategies & academic achievement in online higher education learning environments: A systematic review , 2015, Internet High. Educ..

[227]  C A Nelson,et al.  Learning to Learn , 2017, Encyclopedia of Machine Learning and Data Mining.

[228]  Montse Guitert,et al.  Learner Generated Content: Quality Criteria in online Collaborative Learning , 2011 .

[229]  Ishan Sudeera Abeywardena,et al.  OER Mainstreaming in Tonga , 2019, The International Review of Research in Open and Distributed Learning.

[230]  Damon Guy The Sage Handbook of E‐learning Research , 2008 .

[231]  Roberto Araya,et al.  Assessing Teacher's Discourse Effect on Students' Learning: A Keyword Centrality Approach , 2020, EC-TEL.

[232]  Michelle Schira Hagerman,et al.  Digital Literacies Learning in Contexts of Development: A Critical Review of Six IDRC-Funded Interventions 2016–2018 , 2019, Media and Communication.

[233]  Pierre Dillenbourg,et al.  Design for classroom orchestration , 2013, Comput. Educ..

[234]  Maurizio Naldi,et al.  A review of sentiment computation methods with R packages , 2019, ArXiv.

[235]  Carlos Sotomayor-Beltran,et al.  A spatial assessment on internet access in Peru between 2007 and 2016 and its implications in education and innovation , 2019, 2019 IEEE 1st Sustainable Cities Latin America Conference (SCLA).

[236]  Andrew Lane,et al.  Open Education and the Sustainable Development Goals: Making Change Happen , 2017, Journal of Learning for Development.

[237]  S. Michaels,et al.  Deliberative Discourse Idealized and Realized: Accountable Talk in the Classroom and in Civic Life , 2008 .

[238]  Johnny Saldaña,et al.  Thinking Qualitatively: Methods of Mind , 2014 .

[239]  Deborah I. Fels,et al.  Gamification in theory and action: A survey , 2015, Int. J. Hum. Comput. Stud..

[240]  Vibhor Kant,et al.  Learning path recommendation based on modified variable length genetic algorithm , 2018, Education and Information Technologies.

[241]  Rebecca Ferguson,et al.  Learning analytics: drivers, developments and challenges , 2012 .

[242]  I. Koponen,et al.  Coherent Knowledge Structures of Physics Represented as Concept Networks in Teacher Education , 2010 .

[243]  Ralph Ewerth,et al.  A Recommender System For Open Educational Videos Based On Skill Requirements , 2020, 2020 IEEE 20th International Conference on Advanced Learning Technologies (ICALT).

[244]  June Ahn,et al.  Designing in Context: Reaching Beyond Usability in Learning Analytics Dashboard Design , 2019, J. Learn. Anal..

[245]  Jullia A. Rosdahl,et al.  Readability of patient education materials in ophthalmology: a single-institution study and systematic review , 2016, BMC Ophthalmology.

[246]  Greg Wilson,et al.  Mining student CVS repositories for performance indicators , 2005, MSR.

[247]  Theocharis Kyriacou,et al.  Student Centred Design of a Learning Analytics System , 2019, LAK.

[248]  J. Vermunt Metacognitive, cognitive and affective aspects of learning styles and strategies: A phenomenographic analysis , 1996 .

[249]  Kenneth King,et al.  Education, digital literacy and democracy: the case of Britain’s proposed ‘exit’ from the European Union (Brexit) , 2019, Asia Pacific Education Review.

[250]  Martín Llamas Nistal,et al.  xAPI-SRL: Uses of an application profile for self-regulated learning based on the analysis of learning strategies , 2015, FIE.

[251]  Gerhard H. Schlund,et al.  Anforderungen an die Patientenaufklärung am Beispiel der Strahlentherapie , 2001, Strahlentherapie und Onkologie.

[252]  Irina Radchenko,et al.  On Some Russian Educational Projects in Open Data and Data Journalism , 2016, Open Data for Education.

[253]  Cathy Lewin,et al.  Developing digital pedagogy through learning design: An activity theory perspective , 2018, Br. J. Educ. Technol..

[254]  Yannis A. Dimitriadis,et al.  Exploring teachers' needs and the existing barriers to the adoption of Learning Design methods and tools: A literature survey , 2018, Br. J. Educ. Technol..

[255]  Patricia M. Riddell,et al.  The Influence of Social Contagion Within Education: A Motivational Perspective , 2018, Mind, Brain, and Education.

[256]  E. Aronson The Jigsaw Classroom , 1978 .

[257]  John Sweller,et al.  From Cognitive Load Theory to Collaborative Cognitive Load Theory , 2018, International Journal of Computer-Supported Collaborative Learning.

[258]  Lauri Malmi,et al.  Improving Engagement in Program Construction Examples for Learning Python Programming , 2020, International Journal of Artificial Intelligence in Education.

[259]  S. Bean,et al.  Giving and Receiving Effective Feedback , 2013 .

[260]  Dragan Gasevic,et al.  Complementing educational recommender systems with open learner models , 2020, LAK.

[261]  Svenja Noichl Informatik-Kompetenzen für technikferne Erwachsene zur Teilhabe in der Digitalen Welt , 2019 .

[262]  Robert E. Furrow,et al.  Concept inventories as a resource for teaching evolution , 2019, Evolution: Education and Outreach.

[263]  Lotta Hassi,et al.  Challenge based education: an approach to innovation through multidisciplinary teams of students using Design Thinking , 2018, 2018 XIII Technologies Applied to Electronics Teaching Conference (TAEE).

[264]  Judy Kay,et al.  Mining patterns of events in students’ teamwork data , 2006 .

[265]  Michael Röder,et al.  Exploring the Space of Topic Coherence Measures , 2015, WSDM.

[266]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[267]  Suzanne Morony,et al.  Readability of Written Materials for CKD Patients: A Systematic Review. , 2015, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[268]  Nabil Belacel,et al.  Graph theory based model for learning path recommendation , 2013, Inf. Sci..

[269]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[270]  Inge Molenaar,et al.  Designing dashboards to support learners' self-regulated learning , 2019, LAK 2019.

[271]  Ralf Klamma,et al.  An Augmented Reality Framework for Gamified Learning , 2018, ICWL.

[272]  Luc Van Gool,et al.  Online classification of visual tasks for industrial workflow monitoring , 2011, Neural Networks.

[273]  Kenneth D Royal,et al.  Four tenets of modern validity theory for medical education assessment and evaluation , 2017, Advances in medical education and practice.

[274]  Jeff Grann,et al.  Competency map: visualizing student learning to promote student success , 2014, LAK.

[275]  Karen E Hauer,et al.  Twelve tips to promote successful development of a learner performance dashboard within a medical education program , 2017, Medical teacher.

[276]  Volker Paelke,et al.  Usability-Anforderungen zur Prozessgestaltung , 2009, Usability Professionals.

[277]  Verena Stangl,et al.  Medical Graphic Narratives to Improve Patient Comprehension and Periprocedural Anxiety Before Coronary Angiography and Percutaneous Coronary Intervention: A Randomized Trial , 2019, Annals of Internal Medicine.

[278]  Mads Kock Pedersen,et al.  Getting Humans to do Quantum Optimization - User Acquisition, Engagement and Early Results from the Citizen Cyberscience Game Quantum Moves , 2014, Hum. Comput..

[279]  Jörg-Rüdiger Sack,et al.  A workbench for computational geometry , 2005, Algorithmica.

[280]  Sufen Chen,et al.  A framework for self-regulated digital learning (SRDL) , 2018, J. Comput. Assist. Learn..

[281]  Olga dreeben,et al.  Patient education in rehabilitation , 2010 .

[282]  Marcus Grace,et al.  Reconceptualizing the teaching of controversial issues , 2004 .

[283]  Robin Cowan,et al.  Network Structure and the Diffusion of Knowledge , 2004 .

[284]  Paul Prinsloo,et al.  Learning analytics at the intersections of student trust, disclosure and benefit , 2019, LAK.

[285]  Neil T. Heffernan,et al.  Crowdsourcing and Education: Towards a Theory and Praxis of Learnersourcing , 2018, ICLS.

[286]  Francesco Mondada,et al.  Thymio II, a robot that grows wiser with children , 2013, 2013 IEEE Workshop on Advanced Robotics and its Social Impacts.

[287]  R. Bjork,et al.  Self-regulated learning: beliefs, techniques, and illusions. , 2013, Annual review of psychology.

[288]  Susan Bull,et al.  Introduction of learning visualisations and metacognitive support in a persuadable open learner model , 2016, LAK.

[289]  Olga Viberg,et al.  Assessing the Potential Role of Technology in Promoting Self-Directed Language Learning: A Collaborative Project Between Japan and Sweden , 2018, Relay Journal.

[290]  Ishan Sudeera Abeywardena,et al.  A Collaborative Approach to OER Policy and Guidelines Development in the Commonwealth: The Case of Botswana, Cameroon, and Sri Lanka , 2018 .

[291]  Steven Lonn,et al.  Student explorer: a tool for supporting academic advising at scale , 2014, L@S.

[292]  Tom Murray,et al.  Authoring Tools for Advanced Technology Learning Environments , 2003 .

[293]  E. Mazur,et al.  Peer Instruction: Ten years of experience and results , 2001 .

[294]  Rajul Pandya,et al.  Learning through Citizen Science: Enhancing Opportunities by Design. Consensus Study Report. , 2018 .

[295]  Vincent Aleven,et al.  Does supporting multiple student strategies lead to greater learning and motivation? Investigating a source of complexity in the architecture of intelligent tutoring systems , 2013, Comput. Educ..

[296]  J. Herman,et al.  Defining Twenty-First Century Skills , 2012 .

[297]  Chih-Ming Chen,et al.  An English vocabulary learning app with self-regulated learning mechanism to improve learning performance and motivation , 2018, Computer Assisted Language Learning.

[298]  Juho Kim,et al.  Improving learning with collective learner activity , 2015 .

[299]  J. Tendeiro,et al.  Admission testing for higher education: A multi-cohort study on the validity of high-fidelity curriculum-sampling tests , 2018, PloS one.

[300]  Enhong Chen,et al.  Exploiting Cognitive Structure for Adaptive Learning , 2019, KDD.

[301]  Ralf Klamma,et al.  Gamification of Web-Based Learning Services , 2017, ICWL.

[302]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[303]  Carolyn Penstein Rosé,et al.  Towards an Agile Approach to Adapting Dynamic Collaboration Support to Student Needs , 2014, International Journal of Artificial Intelligence in Education.

[304]  Peter Brusilovsky,et al.  Dynamic Knowledge Modeling with Heterogeneous Activities for Adaptive Textbooks , 2018 .

[305]  Randy L. Bell,et al.  Understandings of the nature of science and decision making on science and technology based issues , 2003 .

[306]  Thomas Meixner,et al.  Using Large Data Sets for Open-Ended Inquiry in Undergraduate Science Classrooms , 2017 .

[307]  Peter Brusilovsky,et al.  Mastery grids: an open-source social educational progress visualization , 2014, ITiCSE '14.

[308]  Ahmad Khanlari,et al.  Teachers’ perceptions of the benefits and the challenges of integrating educational robots into primary/elementary curricula , 2016 .

[309]  Elfreda A. Chatman Diffusion theory: A review and test of a conceptual model in information diffusion , 1986, J. Am. Soc. Inf. Sci..

[310]  Maren Scheffel,et al.  Awareness Is Not Enough: Pitfalls of Learning Analytics Dashboards in the Educational Practice , 2017, EC-TEL.

[311]  S. Hidi,et al.  The Four-Phase Model of Interest Development , 2006 .

[312]  Amy Childre,et al.  Backward Design , 2009 .

[313]  Elizabeth D. Capaldi Phillips,et al.  Improving Advising Using Technology and Data Analytics , 2013 .

[314]  Chien Chou,et al.  Learner readiness for online learning: Scale development and student perceptions , 2010, Comput. Educ..

[315]  Dieudonné Leclercq,et al.  The 8 Learning Events Model and its principles , 2005 .

[316]  Javiera Atenas,et al.  Questions of quality in repositories of open educational resources: a literature review , 2014 .

[317]  J. Galán Serrano,et al.  GAMIFICATION AS A TOOL FOR ACQUISITION SOFT SKILLS IN THE DESIGN FIELD , 2018 .

[318]  Thijs Gillebaart,et al.  FROM CO-CREATED LEARNING RESOURCES TO PERSONALISED ONLINE COURSES FOR BLENDED LEARNING , 2018 .

[319]  Katja Maaß,et al.  What are modelling competencies , 2006 .

[320]  Hassan Khosravi,et al.  Topic Dependency Models: Graph-Based Visual Analytics for Communicating Assessment Data , 2018, J. Learn. Anal..

[321]  Kan Kan Chan,et al.  Using Augmented Reality Flashcards to Learn Vocabulary in Early Childhood Education , 2019, Journal of Educational Computing Research.

[322]  Matthias Söllner,et al.  Unleashing the Potential of Chatbots in Education: A State-Of-The-Art Analysis , 2018, Academy of Management Proceedings.

[323]  Michael S. Horn,et al.  Defining Computational Thinking for Mathematics and Science Classrooms , 2016 .

[324]  Taddy Maddox,et al.  Peabody Developmental Motor Scales , 2008 .

[325]  Marco Tacca,et al.  Guiding Engineering Student Teams’ Ethics Discussions with Peer Advising , 2020, Science and Engineering Ethics.

[326]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[327]  Pedro Jussieu de Rezende,et al.  Animation of geometric algorithms using GeoLab , 1993, SCG '93.

[328]  Mingming Zhou,et al.  Modelling Serbian pre-service teachers' attitudes towards computer use: A SEM and MIMIC approach , 2016, Comput. Educ..

[329]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[330]  Gábor Csárdi,et al.  The igraph software package for complex network research , 2006 .

[331]  Sahana Murthy,et al.  Think-pair-share in a large CS1 class: does learning really happen? , 2014, ITiCSE '14.

[332]  Beverly Park Woolf,et al.  Repairing Disengagement With Non-Invasive Interventions , 2007, AIED.

[333]  Celia A. Evans,et al.  The Neighborhood Nestwatch Program: Participant Outcomes of a Citizen‐Science Ecological Research Project , 2005 .

[334]  Kyle M. L. Jones Advising the whole student: eAdvising analytics and the contextual suppression of advisor values , 2018, Education and Information Technologies.

[335]  G. DURAND,et al.  A Learning Design Recommendation System Based on Markov Decision Processes , 2011 .

[336]  Carlos Delgado Kloos,et al.  Assessing the validity of a learning analytics expectation instrument: A multinational study , 2020, J. Comput. Assist. Learn..

[337]  한승헌,et al.  인터넷 기반 Collaborative Design 시스템 개발 , 1997 .

[338]  Jonathan C. Roberts,et al.  Towards more Visual Analytics in Learning Analytics , 2014, EuroVA@EuroVis.

[339]  Ani Nenkova,et al.  What Makes Writing Great? First Experiments on Article Quality Prediction in the Science Journalism Domain , 2013, TACL.

[340]  G. Ropohl PHILOSOPHY OF SOCIO-TECHNICAL SYSTEMS , 1999 .

[341]  Magy Seif El-Nasr,et al.  Game Analytics - The Basics , 2013, Game Analytics, Maximizing the Value of Player Data.

[342]  Liesbeth Kester,et al.  The Four-Component Instructional Design Model : Multimedia Principles in Environments for Complex Learning , 2014 .

[343]  Uyen Trang Nguyen,et al.  A Study of XSS Worm Propagation and Detection Mechanisms in Online Social Networks , 2013, IEEE Transactions on Information Forensics and Security.

[344]  Luis de Marcos,et al.  Gamifying learning experiences: Practical implications and outcomes , 2013, Comput. Educ..

[345]  R. Weksberg,et al.  Infantile lethal variant of Simpson-Golabi-Behmel syndrome associated with hydrops fetalis. , 1995, American journal of medical genetics.

[346]  Erik Duval,et al.  Learning analytics dashboards , 2017 .

[347]  Jianxia Du,et al.  Factors Affecting Online Groupwork Interest: A Multilevel Analysis , 2013 .

[348]  Mollie Dollinger,et al.  Working Together in Learning Analytics Towards the Co-Creation of Value , 2019, J. Learn. Anal..

[349]  Patrick Jermann,et al.  Classroom orchestration: The third circle of usability , 2011, CSCL.

[350]  Margaret Haughey,et al.  Evaluating Learning Objects for Schools , 2005 .

[351]  Joseph Jay Williams,et al.  RiPPLE: A Crowdsourced Adaptive Platform for Recommendation of Learning Activities , 2019, J. Learn. Anal..

[352]  Dragan Gasevic,et al.  The Student Expectations of Learning Analytics Questionnaire , 2019, J. Comput. Assist. Learn..

[353]  K. Crowley,et al.  From Everyday to Scientific Observation: How Children Learn to Observe the Biologist’s World , 2009 .

[354]  Andrew R. Brown Music Technology and Education: Amplifying Musicality , 2014 .

[355]  Yann Secq,et al.  Patterns and Loops: Early Computational Thinking , 2019, EC-TEL.

[356]  Jorge N. Tendeiro,et al.  Measuring non-cognitive predictors in high-stakes contexts: The effect of self-presentation on self-report instruments used in admission to higher education , 2017 .

[357]  Min Yuan,et al.  Not All Rubrics Are Equal: A Review of Rubrics for Evaluating the Quality of Open Educational Resources , 2015 .

[358]  Kristopher Kyle,et al.  Assessment of language in authentic science inquiry reveals putative differences in epistemology , 2017, LAK.

[359]  Ulrik Schroeder,et al.  Zu alt für Informatik?: Seniorinnen und Senioren erobern die digitale Welt , 2019, GI-Jahrestagung.

[360]  Martin Ebner,et al.  Learning Analytics: Principles and Constraints , 2015 .

[361]  Jodi Asbell-Clarke,et al.  Challenging games help students learn: An empirical study on engagement, flow and immersion in game-based learning , 2016, Comput. Hum. Behav..

[362]  Richard C. Anderson,et al.  On asking people questions about what they are reading , 1975 .

[363]  Arthur C. Graesser,et al.  Natural Language Tutoring: A comparison of human tutors, computer tutors, and text , 2007 .

[364]  Robert H. Ennis A Definition of Critical Thinking , 2016 .

[365]  Gabriela Moise,et al.  MASECO: A Multi-agent System for Evaluation and Classification of OERs and OCW Based on Quality Criteria , 2014, E-Learning Paradigms and Applications.

[366]  Mimi Recker,et al.  Developing and Using a Guide to Assess Learning Resource Quality in Educational Digital Libraries , 2011 .

[367]  Rebecca Jordan,et al.  The impacts of an invasive species citizen science training program on participant attitudes, behavior, and science literacy , 2013, Public understanding of science.

[368]  Paul A. Gagniuc,et al.  Markov Chains: From Theory to Implementation and Experimentation , 2017 .

[369]  Rafiq Zulkarnaen Why is mathematical modeling so difficult for students , 2018 .

[370]  Gianna Cassidy,et al.  Music-games: A case study of their impact , 2013 .

[371]  Kasper Hornbæk,et al.  Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? , 2000, CHI.

[372]  Judy Kay,et al.  Open learner models and learning analytics dashboards: a systematic review , 2018, LAK.

[373]  Magy Seif El-Nasr,et al.  Modeling Individual Differences in Game Behavior Using HMM , 2018, AIIDE.

[374]  Neil T. Heffernan,et al.  The Future of Adaptive Learning: Does the Crowd Hold the Key? , 2016, International Journal of Artificial Intelligence in Education.

[375]  Ulrik Schroeder,et al.  ILSA – Konzept und Implementierung eines integrierten Lernstil-Analysesystems für Moodle , 2019 .

[376]  Yugo Hayashi,et al.  Multiple pedagogical conversational agents to support learner-learner collaborative learning: Effects of splitting suggestion types , 2019, Cognitive Systems Research.

[377]  Peter Goodyear,et al.  The Architecture of Productive Learning Networks , 2014 .

[378]  Tapio Salakoski,et al.  Effectiveness of Program Visualization: A Case Study with the ViLLE Tool , 2008, J. Inf. Technol. Educ. Innov. Pract..

[379]  B. Zimmerman,et al.  The Role of Observation and Emulation in the Development of Athletic Self-Regulation. , 2000 .

[380]  Lorraine Graham,et al.  QuickSmart: a basic academic skills intervention for middle school students with learning difficulties. , 2007, Journal of learning disabilities.

[381]  John Dunlosky,et al.  Overconfidence produces underachievement: Inaccurate self evaluations undermine students’ learning and retention , 2012 .

[382]  J. Simpson,et al.  A previously unrecognized X-linked syndrome of dysmorphia. , 1975, Birth defects original article series.

[383]  Pierre Dillenbourg,et al.  Distributed Awareness for Class Orchestration , 2009, EC-TEL.

[384]  Franziska Frankfurter,et al.  Science Education For Citizenship Teaching Socio Scientific Issues , 2016 .

[385]  Davinia Hernández Leo,et al.  Intelligent Group Formation in Computer Supported Collaborative Learning Scripts , 2017, 2017 IEEE 17th International Conference on Advanced Learning Technologies (ICALT).

[386]  Paolo Torroni,et al.  Argumentation Mining , 2016, ACM Trans. Internet Techn..

[387]  Michail N. Giannakos,et al.  Learning Analytics for Learning Design: A Systematic Literature Review of Analytics-Driven Design to Enhance Learning , 2019, IEEE Transactions on Learning Technologies.

[388]  Barbara Wasson,et al.  Editorial: Learning design, teacher inquiry into student learning and learning analytics: A call for action , 2015, Br. J. Educ. Technol..

[389]  Veruska Oppedisano Open University Admission Policies and Drop Out Rates in Europe , 2009 .

[390]  Tejas I. Dhamecha,et al.  Improving Short Answer Grading Using Transformer-Based Pre-training , 2019, AIED.

[391]  Anna Jobin,et al.  The global landscape of AI ethics guidelines , 2019, Nature Machine Intelligence.

[392]  Eva Alice Christiane Bittner,et al.  The Facilitator is a Bot: towards a Conversational Agent for Facilitating Idea Elaboration on Idea Platforms , 2019, ECIS.

[393]  T. Goetz,et al.  Academic Emotions in Students' Self-Regulated Learning and Achievement: A Program of Qualitative and Quantitative Research , 2002 .

[394]  Josef Buchner,et al.  AUGMENTED REALITY IN TEACHER EDUCATION. A FRAMEWORK TO SUPPORT TEACHERS' TECHNOLOGICAL PEDAGOGICAL CONTENT KNOWLEDGE , 2020 .

[395]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[396]  Daniel L. Schwartz,et al.  Choosing versus Receiving Feedback: The Impact of Feedback Valence on Learning in an Assessment Game , 2016, EDM.

[397]  Paula J. Durlach,et al.  Open Social Student Modeling for Personalized Learning , 2016, IEEE Transactions on Emerging Topics in Computing.

[398]  S. Imenda Is There a Conceptual Difference between Theoretical and Conceptual Frameworks? , 2014 .

[399]  Mathilde M. Bekker,et al.  Designing Kinect games to train motor skills for mixed ability players , 2013, GFHEU.

[400]  J. Krosnick,et al.  Survey research. , 1999, Annual review of psychology.

[401]  Marco Kalz,et al.  Time will tell: The role of mobile learning analytics in self-regulated learning , 2015, Comput. Educ..

[402]  Dennis P. Groth,et al.  Engaging Faculty in Learning Analytics: Agents of Institutional Culture Change , 2019, J. Learn. Anal..

[403]  Selcuk R. Sirin Socioeconomic Status and Academic Achievement: A Meta-Analytic Review of Research , 2005 .

[404]  Jeroen J. G. van Merriënboer,et al.  Cue-based facilitation of self-regulated learning: A discussion of multidisciplinary innovations and technologies , 2019, Comput. Hum. Behav..

[405]  Abraham P. Buunk,et al.  Social Comparison in the Classroom: A Review , 2008 .

[406]  Andrew B. Williams The qualitative impact of using LEGO MINDSTORMS robots to teach computer engineering , 2003, IEEE Trans. Educ..

[407]  Xavier Ochoa,et al.  LADA: A learning analytics dashboard for academic advising , 2020, Comput. Hum. Behav..

[408]  Janice M. Morse,et al.  Nursing Research: The Application of Qualitative Approaches , 1985 .

[409]  William R. King,et al.  A meta-analysis of the technology acceptance model , 2006, Inf. Manag..

[410]  Jovita M. Vytasek,et al.  What if Learning Analytics Were Based on Learning Science , 2016 .

[411]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[412]  Yong Tang,et al.  Personalized learning full-path recommendation model based on LSTM neural networks , 2018, Inf. Sci..

[413]  Pierre Dillenbourg,et al.  Using Sequential Pattern Mining to Explore Learners' Behaviors and Evaluate Their Correlation with Performance in Inquiry-Based Learning , 2017, EC-TEL.

[414]  Carlos Delgado Kloos,et al.  Do MOOCs Sustain the UNESCO’s Quality Education Goal? , 2019, 2019 IEEE Global Engineering Education Conference (EDUCON).

[415]  N. Rummel,et al.  Teacher Competencies for the Implementation of Collaborative Learning in the Classroom: a Framework and Research Review , 2015 .

[416]  Daphne Koller,et al.  Self-Driven Mastery in Massive Open Online Courses , 2013 .

[417]  B. Zimmerman Becoming a Self-Regulated Learner: An Overview , 2002 .

[418]  Susan H. Rodger,et al.  Web-based animation of data structures using JAWAA , 1998, SIGCSE '98.

[419]  María Jesús Rodríguez-Triana,et al.  Perceiving Learning at a Glance: A Systematic Literature Review of Learning Dashboard Research , 2017, IEEE Transactions on Learning Technologies.

[420]  Thomas L. Naps JHAVE: supporting algorithm visualization , 2005, IEEE Computer Graphics and Applications.

[421]  Alexander Schill,et al.  Towards a Development Methodology for Adaptable Collaborative Audience Response Systems , 2019, 2019 18th International Conference on Information Technology Based Higher Education and Training (ITHET).

[422]  Budd L. Hall,et al.  Breaking the Monopoly of Knowledge: Research Methods, Participation and Development , 1978 .

[423]  Rebecca Ferguson,et al.  Human-Centred Learning Analytics , 2019, J. Learn. Anal..

[424]  Pascal Huguet,et al.  Social comparison choices in the classroom: further evidence for students' upward comparison tendency and its beneficial impact on performance , 2001 .

[425]  Jocelyn E. Bolin,et al.  Multilevel Modeling Using R , 2019 .

[426]  Melanie E. Peffer,et al.  Learning Analytics to Assess Beliefs about Science: Evolution of Expertise as Seen through Biological Inquiry , 2020, CBE life sciences education.

[427]  Stuart Naylor,et al.  Argumentation and Primary Science , 2007 .

[428]  P. Scott,et al.  Pedagogical link‐making: a fundamental aspect of teaching and learning scientific conceptual knowledge , 2011 .

[429]  Erik Mannens,et al.  Guiding the choice of learning dashboard visualizations: Linking dashboard design and data visualization concepts , 2019, J. Comput. Lang..

[430]  Mária Bieliková,et al.  Dynamic Group Formation as an Approach to Collaborative Learning Support , 2015, IEEE Transactions on Learning Technologies.

[431]  Dragan Gašević,et al.  The privacy paradox and its implications for learning analytics , 2020, LAK.

[432]  Krzysztof Z. Gajos,et al.  Crowdsourcing step-by-step information extraction to enhance existing how-to videos , 2014, CHI.

[433]  John C. Nesbit,et al.  Supporting Self-Regulated Learning with Cognitive Tools , 2009 .

[434]  Mario Manso-Vázquez,et al.  An xAPI Application Profile to Monitor Self-Regulated Learning Strategies , 2018, IEEE Access.

[435]  Fred Paas,et al.  Exploring sequences of learner activities in relation to self-regulated learning in a massive open online course , 2019, Comput. Educ..

[436]  John E. Crowder,et al.  Modern Synopsis of Comprehensive Textbook of Psychiatry , 1974 .

[437]  Jin-Xia Huang,et al.  A Chatbot for a Dialogue-Based Second Language Learning System. , 2017 .

[438]  H. Arksey,et al.  Scoping studies: towards a methodological framework , 2005 .

[439]  Yifeng Zeng,et al.  Personalized Ranking Metric Embedding for Next New POI Recommendation , 2015, IJCAI.

[440]  Davinia Hernández Leo,et al.  Sustaining Continuous Collaborative Learning Flows in MOOCs: Orchestration Agent Approach , 2018, J. Univers. Comput. Sci..

[441]  Peter Sleegers,et al.  The Effect of Peer Socioeconomic Status on Student Achievement: A Meta-Analysis , 2009 .

[442]  Anne Corbett,et al.  Higher Education Entrance Qualifications and Exams in Europe: A Comparison , 2014 .

[443]  E. Duval Attention please!: learning analytics for visualization and recommendation , 2011, LAK.

[444]  BannertMaria,et al.  Effects of a metacognitive support device in learning environments , 2009 .

[445]  Philippe Vidal,et al.  Reflexive Learning, Socio-cognitive Conflict and Peer-assessment to Improve the Quality of Feedbacks in Online Tests , 2015, EC-TEL.

[446]  Alan F. Smeaton,et al.  An Exploratory Study on Student Engagement with Adaptive Notifications in Programming Courses , 2018, EC-TEL.

[447]  Jorge N. Tendeiro,et al.  Predicting Performance in Higher Education Using Proximal Predictors , 2016, PloS one.

[448]  Padhraic Smyth,et al.  Detecting changes in student behavior from clickstream data , 2017, LAK.

[449]  Douglas Guilbeault,et al.  Complex Contagions: A Decade in Review , 2017, ArXiv.

[450]  Ulrik Schroeder,et al.  Learning Analytics: Challenges and Future Research Directions , 2014 .

[451]  Richard Procter,et al.  Mobilising knowledge through global partnerships to support research-informed teaching: five models for translational research , 2018, Journal of Education for Teaching.

[452]  Soren Auer,et al.  Quality Prediction of Open Educational Resources A Metadata-based Approach , 2020, 2020 IEEE 20th International Conference on Advanced Learning Technologies (ICALT).

[453]  N. Lasry,et al.  Peer instruction: From Harvard to the two-year college , 2008 .

[454]  Philip H. Winne,et al.  Studying as self-regulated learning. , 1998 .

[455]  Wolfgang Nejdl,et al.  Adaptation in Open Corpus Hypermedia , 2001 .

[456]  G. Brosvic,et al.  Immediate Feedback during Academic Testing , 2001, Psychological reports.

[457]  Spyros Vosinakis,et al.  ARQuest: A Tangible Augmented Reality Approach to Developing Computational Thinking Skills , 2019, 2019 11th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games).

[458]  Martin Ebner,et al.  Markov Chain and Classification of Difficulty Levels Enhances the Learning Path in One Digit Multiplication , 2014, HCI.

[459]  D. Krathwohl A Revision of Bloom's Taxonomy: An Overview , 2002 .

[460]  François Bry,et al.  Audience Response Systems Reimagined , 2019, ICWL.

[461]  John T. Stasko,et al.  Please address correspondence to , 2000 .

[462]  Lucia Mason,et al.  Prediction of students' argumentation skills about controversial topics by epistemological understanding , 2006 .

[463]  George Siemens,et al.  Let’s not forget: Learning analytics are about learning , 2015 .

[464]  Matthias Jarke,et al.  Enhancing e-learning with an interactive gamification analytics tool , 2020 .

[465]  Carolyn Penstein Rosé,et al.  Tutorial Dialogue as Adaptive Collaborative Learning Support , 2007, AIED.

[466]  Deborah E. White,et al.  Thematic Analysis , 2017 .

[467]  Nigel Brissett,et al.  For Function or Transformation? A Critical Discourse Analysis of Education under the Sustainable Development Goals. , 2017 .

[468]  Vincent Aleven,et al.  Mastery-Oriented Shared Student/System Control Over Problem Selection in a Linear Equation Tutor , 2016, ITS.

[469]  Jan Marco Leimeister,et al.  Where is the Bot in our Team? Toward a Taxonomy of Design Option Combinations for Conversational Agents in Collaborative Work , 2019, HICSS.

[470]  K. Ambrose,et al.  Principles of management. , 2005, Emergency nurse : the journal of the RCN Accident and Emergency Nursing Association.

[471]  Rui-Ting Huang,et al.  Exploring the impact of self-management of learning and personal learning initiative on mobile language learning: A moderated mediation model , 2019, Australasian Journal of Educational Technology.

[472]  Karen E. Watkins,et al.  Informal and Incidental Learning , 2001 .

[473]  Lot Fonteyne,et al.  Vraag het aan SIMON , 2015 .

[474]  Wolfgang Mulzer,et al.  LiveCG: an Interactive Visualization Environment for Computational Geometry , 2014, Symposium on Computational Geometry.

[475]  Claude Frasson,et al.  Assessing Motivational Strategies in Serious Games Using Hidden Markov Models , 2013, FLAIRS Conference.

[476]  François Bry,et al.  Large class teaching with Backstage , 2017 .

[477]  H. Schielzeth,et al.  The coefficient of determination R2 and intra-class correlation coefficient from generalized linear mixed-effects models revisited and expanded , 2016, bioRxiv.

[478]  Martin Ebner,et al.  De-Identification in Learning Analytics , 2016, J. Learn. Anal..

[479]  Sanjeev Sridharan,et al.  The potential of an online educational platform to contribute to achieving sustainable development goals: a mixed-methods evaluation of the Peoples-uni online platform , 2018, Health Research Policy and Systems.

[480]  Niall Sclater,et al.  Student perceptions of their privacy in leaning analytics applications , 2017, LAK.

[481]  Judy Kay,et al.  MTFeedback: Providing Notifications to Enhance Teacher Awareness of Small Group Work in the Classroom , 2015, IEEE Transactions on Learning Technologies.

[482]  Tzone-I Wang,et al.  A mining-based approach on discovering courses pattern for constructing suitable learning path , 2010, Expert Syst. Appl..

[483]  Louis Glassy,et al.  Using version control to observe student software development processes , 2006 .

[484]  José Paulo Leal,et al.  Estimating time and score uncertainty in generating successful learning paths under time constraints , 2018, Expert Syst. J. Knowl. Eng..

[485]  Prageet Aeron,et al.  Online Education: Worldwide Status, Challenges, Trends, and Implications , 2018, Journal of Global Information Technology Management.

[486]  Erik Duval,et al.  Learning dashboards: an overview and future research opportunities , 2013, Personal and Ubiquitous Computing.

[487]  Feng Wang,et al.  Design-based research and technology-enhanced learning environments , 2005 .

[488]  Kristen E. DiCerbo,et al.  Game-Based Assessment of Persistence , 2014, J. Educ. Technol. Soc..

[489]  Bjørn Fjukstad,et al.  Teaching Electronics and Programming in Norwegian Schools Using the air: bit Sensor Kit , 2019, ITiCSE.

[490]  Vladimir Zadorozhny,et al.  Adaptive Social Learning Based on Crowdsourcing , 2017, IEEE Transactions on Learning Technologies.

[491]  Robin Vivian,et al.  CARDS: A Mixed-Reality System for Collaborative Learning at School , 2019, ISS.

[492]  Stephen H. Edwards,et al.  Algorithm Visualization: The State of the Field , 2010, TOCE.

[493]  Xin Chen,et al.  Checkable answers: Understanding student behaviors with instant feedback in a blended learning class , 2015, 2015 IEEE Frontiers in Education Conference (FIE).

[494]  Gayane Sedrakyan Process-oriented feedback perspectives based on feedback-enabled simulation and learning process data analytics. , 2016 .

[495]  Knut Neumann,et al.  What Makes the Finnish Different in Science? Assessing and Comparing Students' Science Learning in Three Countries , 2014 .

[496]  D. Allen,et al.  What is Problem-Based Learning? , 2006 .

[497]  Jonathan Osborne,et al.  Science Education for the Twenty First Century , 2007 .

[498]  Brett Bixler,et al.  THE EFFECTS OF SCAFFOLDING STUDENT'S PROBLEM-SOLVING PROCESS VIA QUESTION PROMPTS ON PROBLEM SOLVING AND INTRINSIC MOTIVATION IN AN ONLINE LEARNING ENVIRONMENT , 2007 .

[499]  Tian Luo,et al.  Factors Contributing to Student Retention in Online Learning and Recommended Strategies for Improvement: A Systematic Literature Review , 2019, J. Inf. Technol. Educ. Res..

[500]  Yeonjeong Park,et al.  Development of the Learning Analytics Dashboard to Support Students' Learning Performance , 2015, J. Univers. Comput. Sci..

[501]  Judy Kay,et al.  Orchestrating a multi-tabletop classroom: from activity design to enactment and reflection , 2012, ITS '12.

[502]  Katrien Verbert,et al.  Learning dashboards at scale: early warning and overall first year experience , 2019 .

[503]  Matt Homer,et al.  Implicit aspects of paper and pencil mathematics assessment that come to light through the use of the computer , 2007 .

[504]  Anders I. Mørch,et al.  Inclusion through design and use of digital learning environments: issues, methods and stories , 2018, NordiCHI.

[505]  C. Borrego,et al.  Room escape at class: Escape games activities to facilitate the motivation and learning in computer science , 2017 .

[506]  Michel C. Desmarais,et al.  Filtering non-relevant short answers in peer learning applications , 2019, EDM.

[507]  Francesco Mondada,et al.  Pedagogical Uses of Thymio II: How Do Teachers Perceive Educational Robots in Formal Education? , 2016, IEEE Robotics & Automation Magazine.

[508]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[509]  Elizabeth S. Charles,et al.  Harnessing peer instruction in and out of class with myDALITE , 2019 .

[510]  Luca Simeone,et al.  Knowledge translation mechanisms in open innovation: the role of design in R&D projects , 2017, J. Knowl. Manag..

[511]  Peter Brusilovsky,et al.  Open Corpus Adaptive Educational Hypermedia , 2007, The Adaptive Web.

[512]  A. Malik,et al.  The Influences of Emotion on Learning and Memory , 2017, Front. Psychol..

[513]  Tihomir Orehovacki,et al.  Verificator: Educational Tool for Learning Programming , 2009, Informatics Educ..

[514]  George Veletsianos,et al.  Pedagogical Agents , 2013 .

[515]  Michael Yudelson,et al.  How Mastery Learning Works at Scale , 2016, L@S.

[516]  John Dunlosky,et al.  The Cambridge Handbook of Cognition and Education , 2019 .

[517]  Cornelio Yáñez-Márquez,et al.  Social Web Content Enhancement in a Distance Learning Environment: Intelligent Metadata Generation for Resources , 2017 .

[518]  Vincent Aleven,et al.  Example-Tracing Tutors: Intelligent Tutor Development for Non-programmers , 2016, International Journal of Artificial Intelligence in Education.

[519]  David J. Shernoff,et al.  Student engagement in high school classrooms from the perspective of flow theory. , 2003 .

[520]  Olga Viberg,et al.  Mobile collaborative language learning: State of the art , 2018, Br. J. Educ. Technol..

[521]  R. Martens,et al.  Predicting and resolving non-completion in higher (online) education – A literature review , 2020, Educational Research Review.

[522]  Roland Siegwart,et al.  Visual Programming Language for Thymio II Robot , 2014 .

[523]  Leonard Barolli,et al.  A web-based e-learning system for increasing study efficiency by stimulating learner’s motivation , 2006, Inf. Syst. Frontiers.

[524]  Milad Shokouhi,et al.  Community-based bayesian aggregation models for crowdsourcing , 2014, WWW.

[525]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[526]  Claudia Bauzer Medeiros,et al.  Finding out topics in educational materials using their components , 2017, 2017 IEEE Frontiers in Education Conference (FIE).

[527]  Anastasios Karakostas,et al.  Promoting academically productive talk with conversational agent interventions in collaborative learning settings , 2015, Comput. Educ..

[528]  Maren Scheffel,et al.  License to evaluate: preparing learning analytics dashboards for educational practice , 2018, LAK.

[529]  James A. Landay,et al.  Key Phrase Extraction for Generating Educational Question-Answer Pairs , 2019, L@S.

[530]  Y. Sayed,et al.  Education quality, and teaching and learning in the post-2015 education agenda , 2015 .

[531]  Curt Jones Using subversion as an aid in evaluating individuals working on a group coding project , 2010 .

[532]  Yves Punie,et al.  DigComp 2.1: The Digital Competence Framework for Citizens with eight proficiency levels and examples of use , 2017 .

[533]  Rodger W. Bybee,et al.  Scientific Literacy, Science Literacy, and Science Education , 2014 .

[534]  John Hamer,et al.  PeerWise: students sharing their multiple choice questions , 2008, ICER '08.

[535]  Galia Angelova,et al.  Gamification in Education: A Systematic Mapping Study , 2015, J. Educ. Technol. Soc..

[536]  Peter Brusilovsky,et al.  An Intelligent Interface for Learning Content: Combining an Open Learner Model and Social Comparison to Support Self-Regulated Learning and Engagement , 2016, IUI.

[537]  Joseph B. W. Yeo Mathematical tasks: Clarification, classification and choice of suitable tasks for different types of learning and assessment , 2007 .

[538]  Alexander Schill,et al.  Gamification Analytics—Methods and Tools for Monitoring and Adapting Gamification Designs , 2017 .

[539]  Olga Viberg,et al.  The Role of Self-Regulation and Structuration in Mobile Learning , 2019, Int. J. Mob. Blended Learn..

[540]  Liliana Piasecka,et al.  What Does it Feel Like to Use English? Empirical Evidence from EFL Students , 2013 .

[541]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[542]  A. Kawalkar,et al.  Scaffolding Science Talk: The role of teachers' questions in the inquiry classroom , 2013 .

[543]  M. Golabi,et al.  A new X-linked mental retardation-overgrowth syndrome. , 1984, American journal of medical genetics.

[544]  Hassan Khosravi,et al.  Fostering and supporting empirical research on evaluative judgement via a crowdsourced adaptive learning system , 2020, LAK.

[545]  Hadeel S. Alenezi,et al.  Utilizing crowdsourcing and machine learning in education: Literature review , 2020, Education and Information Technologies.

[546]  Marie-Pierre Fayant,et al.  On Being Exposed to Superior Others: Consequences of Self-Threatening Upward Social Comparisons , 2010 .

[547]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[548]  Kavita Rao,et al.  Supporting Academic and Affective Learning Processes for English Language Learners with Universal Design for Learning , 2017 .

[549]  Jennifer K. Olsen,et al.  Orchestrating Combined Collaborative and Individual Learning in the Classroom , 2017 .

[550]  Chaoyun Liang,et al.  Using e-portfolio for learning goal setting to facilitate self-regulated learning of high school students , 2018, Behav. Inf. Technol..

[551]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[552]  John F. Cawley Arithmetic Computation Abilities of Students with Learning Disabilities: Implications for Instruction. , 1996 .

[553]  Trond Are Øritsland,et al.  Culture and Mobile HCI: A Review , 2010 .

[554]  Erik Duval,et al.  Context-Aware Recommender Systems for Learning: A Survey and Future Challenges , 2012, IEEE Transactions on Learning Technologies.

[555]  Emanuele Menegatti,et al.  Representative examples of implementing educational robotics in school based on the constructivist appr oach , 2008 .

[556]  Iryna Gurevych,et al.  Which argument is more convincing? Analyzing and predicting convincingness of Web arguments using bidirectional LSTM , 2016, ACL.

[557]  Päivi Häkkinen,et al.  Specifying computer-supported collaboration scripts , 2007, Int. J. Comput. Support. Collab. Learn..

[558]  Janet Ward Schofield,et al.  Teachers, Computer Tutors, and Teaching: The Artificially Intelligent Tutor as an Agent for Classroom Change , 1994 .

[559]  Andreas Krapp,et al.  Basic needs and the development of interest and intrinsic motivational orientations , 2005 .

[560]  Stavros N. Demetriadis,et al.  AlCoLab: Architecture of Algorithm Visualization System , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[561]  Eric Wallace,et al.  Trick Me If You Can: Human-in-the-Loop Generation of Adversarial Examples for Question Answering , 2018, TACL.

[562]  Javiera Atenas,et al.  Open data as open educational resources: case studies of emerging practice , 2015 .

[563]  Dirk Ifenthaler,et al.  Determining the effectiveness of prompts for self-regulated learning in problem-solving scenarios , 2012, J. Educ. Technol. Soc..

[564]  Sakinah S. J. Alhadad,et al.  Visualizing Data to Support Judgement, Inference, and Decision Making in Learning Analytics: Insights from Cognitive Psychology and Visualization Science , 2018, J. Learn. Anal..

[565]  Kerry Hempenstall How Might A Stage Model Of Reading Development Be Helpful In The Classroom , 2004 .

[566]  A. Rajić,et al.  A scoping review of scoping reviews: advancing the approach and enhancing the consistency , 2014, Research synthesis methods.

[567]  D. Boud,et al.  Sustainable assessment revisited , 2016 .

[568]  Helen Purchase,et al.  Peer-review in practice: eight years of Aropä , 2018 .

[569]  J. Gee Learning by design: Games as learning machines , 2004 .

[570]  Michel C. Desmarais,et al.  DALITE: Asynchronous Peer Instruction for MOOCs , 2016, EC-TEL.

[571]  Theresa Dirndorfer Anderson,et al.  Co-designing learning analytics tools with learners , 2018, Learning Analytics in the Classroom.

[572]  Vincent Aleven,et al.  Designing for Complementarity: Teacher and Student Needs for Orchestration Support in AI-Enhanced Classrooms , 2019, AIED.

[573]  Judy Kay,et al.  LATUX: an Iterative Workflow for Designing, Validating and Deploying Learning Analytics Visualisations , 2016 .

[574]  Philip H. Winne,et al.  Measuring Self-Regulated Learning , 2000 .