Eye-tracking and artificial intelligence to enhance motivation and learning

The interaction with the various learners in a Massive Open Online Course (MOOC) is often complex. Contemporary MOOC learning analytics relate with click-streams, keystrokes and other user-input variables. Such variables however, do not always capture users’ learning and behavior (e.g., passive video watching). In this paper, we present a study with 40 students who watched a MOOC lecture while their eye-movements were being recorded. We then proposed a method to define stimuli-based gaze variables that can be used for any kind of stimulus. The proposed stimuli-based gaze variables indicate students’ content-coverage (in space and time) and reading processes (area of interest based variables) and attention (i.e., with-me-ness), at the perceptual (following teacher’s deictic acts) and conceptual levels (following teacher discourse). In our experiment, we identified a significant mediation effect of the content coverage, reading patterns and the two levels of with-me-ness on the relation between students’ motivation and their learning performance. Such variables enable common measurements for the different kind of stimuli present in distinct MOOCs. Our long-term goal is to create student profiles based on their performance and learning strategy using stimuli-based gaze variables and to provide students gaze-aware feedback to improve overall learning process. One key ingredient in the process of achieving a high level of adaptation in providing gaze-aware feedback to the students is to use Artificial Intelligence (AI) algorithms for prediction of student performance from their behaviour. In this contribution, we also present a method combining state-of-the-art AI technique with the eye-tracking data to predict student performance. The results show that the student performance can be predicted with an error of less than 5%.

[1]  Patrick Jermann,et al.  Shaping learners’ attention in Massive Open Online Courses , 2015 .

[2]  Radek Pelánek,et al.  Metrics for Evaluation of Student Models , 2015, EDM.

[3]  Michail N. Giannakos,et al.  Exploring the video-based learning research: A review of the literature , 2013, Br. J. Educ. Technol..

[4]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[5]  Daniel C. Richardson,et al.  The Art of Conversation Is Coordination , 2007, Psychological science.

[6]  Pierre Dillenbourg,et al.  Teaching analytics: towards automatic extraction of orchestration graphs using wearable sensors , 2016, LAK.

[7]  Alan Kennedy,et al.  Book Review: Eye Tracking: A Comprehensive Guide to Methods and Measures , 2016, Quarterly journal of experimental psychology.

[8]  K. Millis,et al.  Rereading Strategically: The Influences of Comprehension Ability and a Prior Reading on the Memory for Expository Text. , 2001 .

[9]  Patrick Jermann,et al.  "With-Me-Ness": A Gaze-Measure for Students' Attention in MOOCs , 2014, ICLS.

[10]  Yoav Bergner,et al.  Who does what in a massive open online course? , 2014, Commun. ACM.

[11]  Mark Grabe,et al.  Cumulative Achievement in a Mastery Instructional System: The Impact of Differences in Resultant Achievement Motivation and Persistence , 1981 .

[12]  Ara Darzi,et al.  Eye-tracking technology in medical education: A systematic review , 2017, Medical teacher.

[13]  Robert M. Kaplan,et al.  Nader's Raid on the Testing Industry: Is It in the Best Interest of the Consumer?. , 1982 .

[14]  Pierre Dillenbourg,et al.  Sharing Solutions: Persistence and Grounding in Multimodal Collaborative Problem Solving , 2006 .

[15]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[16]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[17]  Alexander W. Astin Predicting academic performance in college : selectivity data for 2300 American colleges , 1971 .

[18]  Thierry Volery,et al.  Critical success factors in online education , 2000 .

[19]  Marina Schmid,et al.  Imagery And Verbal Processes , 2016 .

[20]  S. Paris,et al.  The benefits of informed instruction for children's reading awareness and comprehension skills. , 1984 .

[21]  Patrick Jermann,et al.  Looking AT versus Looking THROUGH: A Dual Eye-Tracking Study in MOOC Context , 2015, CSCL.

[22]  R. Mayer,et al.  Nine Ways to Reduce Cognitive Load in Multimedia Learning , 2003 .

[23]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[24]  R. Tibshirani,et al.  Generalized additive models for medical research , 1986, Statistical methods in medical research.

[25]  Brian Byrne,et al.  Longitudinal Data on the Relations of Word-Reading Strategies to Comprehension, Reading Time, and Phonemic Awareness. , 1992 .

[26]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[27]  S. Derry,et al.  Video Research in the Learning Sciences , 2007 .

[28]  Werner Severin,et al.  Another look at cue summation , 1967 .

[29]  Sarah L. Dowhower Effects of Repeated Reading on Second-Grade Transitional Readers' Fluency and Comprehension. , 1987 .

[30]  J. Finn Withdrawing From School , 1989 .

[31]  Darius Miniotas,et al.  Visualization of eye gaze data using heat maps , 2007 .

[32]  Carlos Delgado Kloos,et al.  Prediction in MOOCs: A Review and Future Research Directions , 2019, IEEE Transactions on Learning Technologies.

[33]  Fouad A. Tobagi Distance Learning with Digital Video , 1995, IEEE Multim..

[34]  Wilhelmina C. Savenye,et al.  Mental effort and video-based learning: The relationship of preconceptions and the effects of interactive and covert practice , 1991 .

[35]  Michail N. Giannakos,et al.  Making Sense of Video Analytics: Lessons Learned from Clickstream Interactions, Attitudes, and Learning Outcome in a Video-Assisted Course. , 2015 .

[36]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[37]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[38]  René F. Kizilcec,et al.  Showing face in video instruction: effects on information retention, visual attention, and affect , 2014, CHI.

[39]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[40]  David Reinking,et al.  Computer-Mediated Text and Comprehension Differences: The Role of Reading Time, Reader Preference, and Estimation of Learning. , 1988 .

[41]  Krzysztof Z. Gajos,et al.  Crowdsourcing step-by-step information extraction to enhance existing how-to videos , 2014, CHI.

[42]  Patrick Jermann,et al.  Effects of sharing text selections on gaze cross-recurrence and interaction quality in a pair programming task , 2012, CSCW.

[43]  Thomas L. Good,et al.  Time on Task: A Naturalistic Study in Sixth-Grade Classrooms , 1978, The Elementary School Journal.

[44]  Scott D. Johnson,et al.  The Effect of Context-Based Video Instruction on Learning and Motivation in Online Courses , 2005 .

[45]  Kursat Cagiltay,et al.  A systematic review of eye tracking research on multimedia learning , 2018, Comput. Educ..

[46]  J. Biggs,et al.  The revised two-factor Study Process Questionnaire: R-SPQ-2F. , 2001, The British journal of educational psychology.

[47]  Maiga Chang,et al.  Smart learning environments , 2015 .