Automatic feedback in online learning environments: A systematic literature review

[1]  D. Sadler.  Formative assessment and the design of instructional systems , 1989 .

[2]  P. Winne,et al.  Feedback and Self-Regulated Learning: A Theoretical Synthesis , 1995 .

[3]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[4]  Patricia Rogers.  Barriers to Adopting Emerging Technologies in Education , 2000 .

[5]  G. Cziko,et al.  Teacher Adoption of Technology: A Perceptual Control Theory Perspective , 2001 .

[6]  B. Hodges,et al.  Student feedback in problem based learning: a survey of 103 final year students across five Ontario medical schools , 2001, Medical education.

[7]  G. S. Ypsilandis,et al.  Feedback in Distance Education , 2002 .

[8]  Mariana Hentea,et al.  A perspective on fulfilling the expectations of distance education , 2003, CITC4 '03.

[9]  A. Mutch.  Exploring the Practice of Feedback to Students , 2003 .

[10]  Lee Harvey,et al.  Student Feedback [1] , 2003 .

[11]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[12]  Rick Sheridan.  Reducing the Online Instructor's Workload , 2006 .

[13]  M. Weaver,et al.  Do students value feedback? Student perceptions of tutors’ written responses , 2006 .

[14]  Réjean Landry,et al.  Lessons from Innovation Empirical Studies in the Manufacturing Sector: A Systematic Review of the Literature from 1993-2003 , 2006 .

[15]  J. Hattie,et al.  The Power of Feedback , 2007 .

[16]  Chin-Chung Tsai,et al.  On-line peer assessment and the role of the peer feedback: A study of high school computer course , 2007, Comput. Educ..

[17]  Deirdre Burke,et al.  Strategies for using feedback students bring to higher education , 2009 .

[18]  James C. Lester,et al.  Evaluating the consequences of affective feedback in intelligent tutoring systems , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[19]  Maite Urretavizcaya,et al.  Helping Teachers to Track Student Evolution in a B-Learning Environment , 2009, 2009 Ninth IEEE International Conference on Advanced Learning Technologies.

[20]  Pieter Rombouts,et al.  Web-Based Trainer for Electrical Circuit Analysis , 2009, IEEE Transactions on Education.

[21]  Jin Hyung Kim,et al.  Pen-Based Intelligent Tutor for Simultaneous Equations , 2009, 2009 Chinese Conference on Pattern Recognition.

[22]  Alex Davis,et al.  Rehearsing Naval Tactical Situations Using Simulated Teammates and an Automated Tutor , 2009, IEEE Transactions on Learning Technologies.

[23]  Fuhua Lin,et al.  QuizMASter - A Multi-Agent Game-Style Learning Activity , 2009, Edutainment.

[24]  Petri Ihantola,et al.  Review of recent systems for automatic assessment of programming assignments , 2010, Koli Calling.

[25]  John Hattie,et al.  INSTRUCTION BASED ON FEEDBACK , 2010 .

[26]  Dominic Palmer-Brown,et al.  Evaluating Student Response Driven Feedback in a Programming Course , 2010, 2010 10th IEEE International Conference on Advanced Learning Technologies.

[27]  Christopher R. Jones,et al.  Net generation or Digital Natives: Is there a distinct new generation entering university? , 2010, Comput. Educ..

[28]  Lauri Malmi,et al.  Jype - a program visualization and programming exercise tool for Python , 2010, SOFTVIS '10.

[29]  Fridolin Wild,et al.  Using Language Technologies to support individual formative feedback , 2010 .

[30]  M. Price,et al.  Feedback : all that effort, but what is the effect? , 2010 .

[31]  Ming-Hsiung Ying,et al.  The development of an online SQL learning system with automatic checking mechanism , 2011, The 7th International Conference on Networked Computing and Advanced Information Management.

[32]  Pieter Rombouts,et al.  Validation of Symbolic Expressions in Circuit Analysis E-Learning , 2011, IEEE Transactions on Education.

[33]  Martin Field,et al.  Defining precise measurements with sketched annotations , 2011, SBIM '11.

[34]  Moffat Mathews,et al.  Thermo-Tutor: An Intelligent Tutoring System for thermodynamics , 2011, 2011 IEEE Global Engineering Education Conference (EDUCON).

[35]  Youngjun Lee,et al.  A review of online course dropout research: implications for practice and future research , 2011 .

[36]  Richard E. Mayer,et al.  Five facets of social presence in online distance education , 2012, Comput. Hum. Behav..

[37]  Sandra Camargo Pinto Ferraz Fabbri,et al.  Using GQM and TAM to evaluate StArt - a tool that supports Systematic Review , 2012, CLEI Electron. J..

[38]  Petri Ihantola,et al.  A mobile learning application for parsons problems with automatic feedback , 2012, Koli Calling.

[39]  A. M. Alimi,et al.  Towards an educational tool for Arabic handwriting learning , 2012, International Conference on Education and e-Learning Innovations.

[40]  Jonathan E. Taylor,et al.  Enhancing student learning experience through a novel electronic coursework assessment and feedback management system , 2012 .

[41]  Ming-Hsiung Ying,et al.  Development of a Multiplayer Online Game-Based Learning System Based on ARCS Motivation Model , 2012, ICGEC.

[42]  Dragan Gasevic,et al.  Student modeling and assessment in intelligent tutoring of software patterns , 2012, Expert Syst. Appl..

[43]  Lauri Malmi,et al.  How do students solve parsons programming problems?: an analysis of interaction traces , 2012, ICER '12.

[44]  Pierre Dillenbourg,et al.  Design for classroom orchestration , 2013, Comput. Educ..

[45]  Wim Westera,et al.  On the cybernetic arrangement of feedback in serious games: A systems-theoretical perspective , 2015, Education and Information Technologies.

[46]  Mitsuo Yamashiro,et al.  Preliminary Construction of Instant Qualitative Feedback System in Foreign Language Teaching , 2013, 2013 Second IIAI International Conference on Advanced Applied Informatics.

[47]  Bassam Al-Hamad,et al.  E-Assessment as a Tool to Augment Face-to-Face Teaching and Learning Environment , 2013, 2013 Fourth International Conference on e-Learning "Best Practices in Management, Design and Development of e-Courses: Standards of Excellence and Creativity".

[48]  Erik Duval,et al.  Learning dashboards: an overview and future research opportunities , 2013, Personal and Ubiquitous Computing.

[49]  Michael S. Bernstein,et al.  Crowd-scale interactive formal reasoning and analytics , 2013, UIST.

[50]  Marek Hatala,et al.  Factors influencing beliefs for adoption of a learning analytics tool: An empirical study , 2013, Comput. Educ..

[51]  Roy P. Pargas,et al.  Teaching data structures with beSocratic , 2013, ITiCSE '13.

[52]  D. Boud,et al.  Rethinking models of feedback for learning: the challenge of design , 2013 .

[53]  Traian Rebedea,et al.  PolyCAFe—automatic support for the polyphonic analysis of CSCL chats , 2014, Int. J. Comput. Support. Collab. Learn..

[54]  Alyssa Friend Wise,et al.  Designing pedagogical interventions to support student use of learning analytics , 2014, LAK.

[55]  José Francisco de Magalhães Netto,et al.  TUtor Collaborator Using Multi-Agent System , 2014, CollabTech.

[56]  Sumit Gulwani,et al.  Feedback generation for performance problems in introductory programming assignments , 2014, SIGSOFT FSE.

[57]  David Bañeres,et al.  Experiences in Digital Circuit Design Courses: A Self-Study Platform for Learning Support , 2014, IEEE Transactions on Learning Technologies.

[58]  Bozidar Kovacic,et al.  Using data mining for learning path recommendation and visualization in an intelligent tutoring system , 2014, 2014 37th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[59]  Johanna D. Moore,et al.  BEETLE II: Deep Natural Language Understanding and Automatic Feedback Generation for Intelligent Tutoring in Basic Electricity and Electronics , 2014, International Journal of Artificial Intelligence in Education.

[60]  Marcelo Worsley,et al.  Programming Pluralism: Using Learning Analytics to Detect Patterns in the Learning of Computer Programming , 2014 .

[61]  Johan Jeuring,et al.  Strategy-based feedback in a programming tutor , 2014, CSERC.

[62]  Alan F. Smeaton,et al.  Using Educational Analytics to Improve Test Performance , 2015, EC-TEL.

[63]  Claus A. Usener.  EASy-DSBuilder: automated assessment of tree data structures in computer science teaching , 2015, SAC.

[64]  Gökhan Akçapinar,et al.  How automated feedback through text mining changes plagiaristic behavior in online assignments , 2015, Comput. Educ..

[65]  Harry B. Santoso,et al.  Development of gamification-enriched pedagogical agent for e-Learning system based on community of inquiry , 2015 .

[66]  Julián Chaparro-Peláez,et al.  Applying social learning analytics to message boards in online distance learning: A case study , 2015, Comput. Hum. Behav..

[67]  Jéssyka Vilela,et al.  Applications of ontologies in requirements engineering: a systematic review of the literature , 2015, Requirements Engineering.

[68]  Prasenjit Dey,et al.  VibRein: An Engaging and Assistive Mobile Learning Companion for Students with Intellectual Disabilities , 2015, OZCHI.

[69]  Sumit Gulwani,et al.  How Can Automatic Feedback Help Students Construct Automata? , 2015, ACM Trans. Comput. Hum. Interact..

[70]  Marek Hatala,et al.  Learning at distance: Effects of interaction traces on academic achievement , 2015, Comput. Educ..

[71]  Richard G. Baraniuk,et al.  Mathematical Language Processing: Automatic Grading and Feedback for Open Response Mathematical Questions , 2015, L@S.

[72]  Stephen G. Pulman,et al.  OpenEssayist: a supply and demand learning analytics tool for drafting academic essays , 2015, LAK.

[73]  Lilia Cheniti Belcadhi.  Personalized feedback for self assessment in lifelong learning environments based on semantic web , 2016 .

[74]  Tetsuro Kakeshita,et al.  Student Feedback Function for Web-Based Programming Education Support Tool Pgtracer , 2016, 2016 5th IIAI International Congress on Advanced Applied Informatics (IIAI-AAI).

[75]  Pierre Dillenbourg,et al.  Teaching analytics: towards automatic extraction of orchestration graphs using wearable sensors , 2016, LAK.

[76]  Abelardo Pardo,et al.  Data2U: scalable real time student feedback in active learning environments , 2016, LAK.

[77]  Johan Jeuring,et al.  Towards a Systematic Review of Automated Feedback Generation for Programming Exercises , 2016, ITiCSE.

[78]  Munaisyah Abdullah,et al.  The architecture of Agent-Based Intelligent Tutoring System for the learning of software engineering Function Point Metrics , 2016, 2016 2nd International Symposium on Agent, Multi-Agent Systems and Robotics (ISAMSR).

[79]  Mika Ohtsuki,et al.  Software engineer education support system ALECSS utilizing DevOps tools , 2016, iiWAS.

[80]  Sumit Gulwani,et al.  Semi-supervised verified feedback generation , 2016, SIGSOFT FSE.

[81]  Ig Ibert Bittencourt,et al.  Does peer assessment in on-line learning environments work? A systematic review of the literature , 2016, Computers in Human Behavior.

[82]  Michael Poppleton,et al.  Using Fast Model-Based Fault Localisation to Aid Students in Self-Guided Program Repair and to Improve Assessment , 2016, ITiCSE.

[83]  Emma Mulliner,et al.  Feedback on feedback practice: perceptions of students and academics , 2017 .

[84]  Parma Nand,et al.  GENERATION : A SURVEY AND CLASSIFICATION OF THE EMPIRICAL LITERATURE , 2017 .

[85]  Johan Jeuring,et al.  Generating Hints and Feedback for Hilbert-style Axiomatic Proofs , 2017, SIGCSE.

[86]  Dragan Gasevic,et al.  Effects of instructional conditions and experience on the adoption of a learning tool , 2017, Comput. Hum. Behav..

[87]  Sung-Hee Jin,et al.  Using Visualization to Motivate Student Participation in Collaborative Online Learning Environments , 2017, J. Educ. Technol. Soc..

[88]  Diego Riofrío-Luzcando,et al.  Predicting Student Actions in a Procedural Training Environment , 2017, IEEE Transactions on Learning Technologies.

[89]  Yuan-Chih Yu,et al.  Teaching with a Dual-Channel Classroom Feedback System in the Digital Classroom Environment , 2017, IEEE Transactions on Learning Technologies.

[90]  Carlos R. Rivero,et al.  Automated Personalized Feedback in Introductory Java Programming MOOCs , 2017, 2017 IEEE 33rd International Conference on Data Engineering (ICDE).

[91]  Johan Jeuring,et al.  An intelligent tutor to learn the evaluation of microcontroller I/O programming expressions , 2017, Koli Calling.

[92]  María Jesús Rodríguez-Triana,et al.  Perceiving Learning at a Glance: A Systematic Literature Review of Learning Dashboard Research , 2017, IEEE Transactions on Learning Technologies.

[93]  Geert-Jan Houben,et al.  Follow the successful crowd: raising MOOC completion rates through social comparison at scale , 2017, LAK.

[94]  Kamal Eddine El Kadiri,et al.  Learning Management System and the Underlying Learning Theories , 2017, SCA.

[95]  Jiyou Jia,et al.  Evaluating an Intelligent Tutoring System for Personalized Math Teaching , 2017, 2017 International Symposium on Educational Technology (ISET).

[96]  Oscar M. Salazar,et al.  Multi-agent Model for Failure Assessment and Diagnosis in Teaching-Learning Processes , 2017, PAAMS.

[97]  Sathiamoorthy Manoharan,et al.  Personalized Assessment as a Means to Mitigate Plagiarism , 2017, IEEE Transactions on Education.

[98]  Anjo Anjewierden,et al.  Providing guidance in virtual lab experimentation: the case of an experiment design tool , 2018, Educational Technology Research and Development.

[99]  Andreas Seitz,et al.  ArTEMiS: An Automatic Assessment Management System for Interactive Learning , 2018, SIGCSE.

[100]  Guangzhong Sun,et al.  The framework of a new online judge system for programming education , 2018, TURC.

[101]  Xiaolan Xie,et al.  Research on Personalized Exercises and Teaching Feedback Based on Big Data , 2018 .

[102]  Charles R. Graham,et al.  The design, development, and implementation of student-facing learning analytics dashboards , 2018, Journal of Computing in Higher Education.

[103]  Abelardo Pardo,et al.  A feedback model for data-rich learning experiences , 2018 .

[104]  Pushmeet Kohli,et al.  Neuro-Symbolic Program Corrector for Introductory Programming Assignments , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE).

[105]  Ye Wang,et al.  SLIONS: A Karaoke Application to Enhance Foreign Language Learning , 2018, ACM Multimedia.

[106]  Szymon Wasik,et al.  A Survey on Online Judge Systems and Their Applications , 2017, ACM Comput. Surv..

[107]  David Boud,et al.  The development of student feedback literacy: enabling uptake of feedback , 2018 .

[108]  Mohamed Medhat Gaber,et al.  OntoPeFeGe: Ontology-Based Personalized Feedback Generator , 2018, IEEE Access.

[109]  Rishabh Singh,et al.  Search, align, and repair: data-driven feedback generation for introductory programming exercises , 2017, PLDI.

[110]  George Siemens,et al.  OnTask: Delivering Data-Informed, Personalized Learning Support Actions , 2018, J. Learn. Anal..

[111]  David Boud,et al.  What makes for effective feedback: staff and student perspectives , 2019 .

[112]  Dragan Gasevic,et al.  Using learning analytics to scale the provision of personalised feedback , 2019, Br. J. Educ. Technol..

[113]  Dragan Gasevic,et al.  An Analysis of the use of Good Feedback Practices in Online Learning Courses , 2019, 2019 IEEE 19th International Conference on Advanced Learning Technologies (ICALT).

[114]  Georgios Kostopoulos,et al.  Implementing AutoML in Educational Data Mining for Prediction Tasks , 2019, Applied Sciences.

[115]  Johanna D. Moore,et al.  Analysing discussion forum data: a replication study avoiding data contamination , 2019, LAK.

[116]  Johan Jeuring,et al.  A Systematic Literature Review of Automated Feedback Generation for Programming Exercises , 2018, ACM Trans. Comput. Educ..

[117]  Dragan Gasevic,et al.  How do we start? An approach to learning analytics adoption in higher education , 2019, The International Journal of Information and Learning Technology.

[118]  Evandro Costa,et al.  Text mining in education , 2019, WIREs Data Mining Knowl. Discov..

[119]  A. Wise,et al.  Teaching with Analytics: Towards a Situated Model of Instructional Decision-Making , 2019, J. Learn. Anal..

[120]  Tracii Ryan,et al.  Conditions that enable effective feedback , 2019, Higher Education Research & Development.

[121]  Haoran Xie,et al.  Detecting latent topics and trends in educational technologies over four decades using structural topic modeling: A retrospective of all volumes of Computers & Education , 2020, Comput. Educ..

[122]  Dragan Gašević,et al.  Towards automatic cross-language classification of cognitive presence in online discussions , 2020, LAK.

[123]  Cristóbal Romero,et al.  Educational data mining and learning analytics: An updated survey , 2020, WIREs Data Mining Knowl. Discov..

[124]  Dragan Gasevic,et al.  Collaborative peer feedback and learning analytics: theory-oriented design for supporting class-wide interventions , 2020, Assessment & Evaluation in Higher Education.

[125]  Dragan Gašević,et al.  How good is my feedback?: a content analysis of written feedback , 2020, LAK.

[126]  Dirk T. Tempelaar,et al.  Learning Feedback Based on Dispositional Learning Analytics , 2020, Machine Learning Paradigms.

[127]  Haoran Xie,et al.  Fifty years of British Journal of Educational Technology: A topic modeling based bibliometric perspective , 2020, Br. J. Educ. Technol..

[128]  Dragan Gasevic,et al.  Student appreciation of data-driven feedback: A pilot study on OnTask , 2021, LAK.