Eliciting Motivation Knowledge from Log Files Towards Motivation Diagnosis for Adaptive Systems

Motivation is well-known for its importance in learning and its influence on cognitive processes. Adaptive systems would greatly benefit from having a user model of the learner's motivation, especially if integrated with information about knowledge. In this paper a log file analysis for eliciting motivation knowledge is presented, as a first step towards a user model for motivation. Several data mining techniques are used in order to find the best method and the best indicators for disengagement prediction. Results show a very good level of prediction: around 87% correctly predicted instances of all three levels of engagement and 93% correctly predicted instances of disengagement. Data sets with reduced attribute sets show similar results, indicating that engagement level can be predicted from information like reading pages and taking tests, which are common to most e-Learning systems.

[1]  Helen Pain,et al.  Informing the Detection of the Students' Motivational State: An Empirical Study , 2002, Intelligent Tutoring Systems.

[2]  J. Beck,et al.  An Educational Data Mining Tool to Browse Tutor-Student Interactions : Time Will Tell ! , 2005 .

[3]  Robert Irizarry,et al.  Self-Efficacy & Motivation Effects on Online Psychology Student Retention. , 2002 .

[4]  Alvin Y. Wang,et al.  Predictors of web-student performance: the role of self-efficacy and reasons for taking an on-line class , 2002, Comput. Hum. Behav..

[5]  Judy Kay,et al.  Mining patterns of events in students’ teamwork data , 2006 .

[6]  Beverly Park Woolf,et al.  Inferring Unobservable Learning Variables from Students' Help Seeking Behavior , 2004, Intelligent Tutoring Systems.

[7]  Manolis Tzagarakis,et al.  Hypermedia: Openness, Structural Awareness, and Adaptivity , 2002, Lecture Notes in Computer Science.

[8]  Scotty D. Craig,et al.  Integrating Affect Sensors in an Intelligent Tutoring System , 2004 .

[9]  M. Lombard,et al.  Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability , 2002 .

[10]  Joseph E. Beck,et al.  Engagement tracing: using response times to model student disengagement , 2005, AIED.

[11]  Ian Witten,et al.  Data Mining , 2000 .

[12]  A. Bandura.  Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[13]  Yuri Ivanov,et al.  Probabilistic combination of multiple modalities to detect interest , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[14]  Mihaela Cocea,et al.  Can Log Files Analysis Estimate Learners' Level of Motivation? , 2006, LWA.

[15]  Jack Mostow,et al.  Lessons on Using ITS Data to Answer Educational Research Questions , 2004 .

[16]  Mihaela Cocea,et al.  Motivation: included or excluded from E-learning , 2006 .

[17]  J. Keller.  Development and use of the ARCS model of instructional design , 1987 .

[18]  Cheryl Campanella Bracken,et al.  Practical Resources for Assessing and Reporting Intercoder Reliability in Content Analysis Research Projects , 2005 .

[19]  Agathe Merceron,et al.  A Web-Based Tutoring Tool with Mining Facilities to Improve Learning and Teaching , 2003 .

[20]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[21]  B. Zimmerman,et al.  Self-regulation of learning and performance: Issues and educational applications. , 1994 .

[22]  W. Lewis Johnson,et al.  Detecting the Learner's Motivational States in An Interactive Learning Environment , 2005, AIED.

[23]  Rosalind W. Picard,et al.  Classical and novel discriminant features for affect recognition from speech , 2005, INTERSPEECH.

[24]  Klaus Krippendorff,et al.  Answering the Call for a Standard Reliability Measure for Coding Data , 2007 .

[25]  Stephan Weibelzahl,et al.  Developing Adaptive Internet Based Courses with the Authoring System NetCoach , 2001, OHS-7/SC-3/AH-3.

[26]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[27]  Charles B. Hodges.  Designing to Motivate: Motivational Techniques to Incorporate in E-Learning Experiences , 2004 .