Hidden Markov Model for Inferring Learner Task Using Mouse Movement

One of the issues of e-learning web based application is to understand how the learner interacts with an e-learning application to perform a given task. This study proposes a methodology to analyze learner mouse movement in order to infer the task performed. To do this, a Hidden Markov Model is used for modeling the interaction of the learner with an e-learning application. The obtained results show the ability of our model to analyze the interaction in order to recognize the task performed by the learner.

[1]  Ryen W. White,et al.  Improving searcher models using mouse cursor activity , 2012, SIGIR '12.

[2]  Gerhard Tröster,et al.  Robust Recognition of Reading Activity in Transit Using Wearable Electrooculography , 2009, Pervasive.

[3]  Christoph Peylo,et al.  W2 - Adaptive and Intelligent Web-Based Education Systems , 2003, Intelligent Tutoring Systems.

[4]  Luo Si,et al.  Learning to Identify Students' Off-Task Behavior in Intelligent Tutoring Systems , 2009, AIED.

[5]  Joseph H. Goldberg,et al.  Eye tracking in web search tasks: design implications , 2002, ETRA.

[6]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[7]  Ryen W. White,et al.  No clicks, no problem: using cursor movements to understand and improve search , 2011, CHI.

[8]  B. Tatler,et al.  Yarbus, eye movements, and vision , 2010, i-Perception.

[9]  Arthur M. Jacobs,et al.  OGAMA (Open Gaze and Mouse Analyzer): Open-source software designed to analyze eye and mouse movements in slideshow study designs , 2008, Behavior research methods.

[10]  Yoshinori Miyazaki,et al.  Web application for recording learners’ mouse trajectories and retrieving their study logs for data analysis , 2012 .

[11]  James J. Clark,et al.  Visual Task Inference Using Hidden Markov Models , 2011, IJCAI.

[12]  Gerhard Tröster,et al.  Eye Movement Analysis for Activity Recognition Using Electrooculography , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Jonathan B Freeman,et al.  MouseTracker: Software for studying real-time mental processing using a computer mouse-tracking method , 2010, Behavior research methods.

[14]  Eugene Agichtein,et al.  Exploring mouse movements for inferring query intent , 2008, SIGIR '08.

[15]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[16]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[17]  John R. Anderson,et al.  What can a mouse cursor tell us more?: correlation of eye/mouse movements on web browsing , 2001, CHI Extended Abstracts.

[18]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[19]  François Courtemanche,et al.  Physiological Measures, Eye Tracking and Task Analysis to Track User Reactions in User Generated Content , 2010 .

[20]  Peter Brusilovsky,et al.  Adaptive and Intelligent Web-based Educational Systems , 2003, Int. J. Artif. Intell. Educ..

[21]  Gwo-Dong Chen,et al.  Web Learning Portfolios: A Tool For Supporting Performance Awareness , 2001 .