Temporal learning analytics for computer based testing

Predicting student's performance is a challenging, yet complicated task for institutions, instructors and learners. Accurate predictions of performance could lead to improved learning outcomes and increased goal achievement. In this paper we explore the predictive capabilities of student's time-spent on answering (in-)correctly each question of a multiple-choice assessment quiz, along with student's final quiz-score, in the context of computer-based testing. We also explore the correlation between the time-spent factor (as defined here) and goal-expectancy. We present a case study and investigate the value of using this parameter as a learning analytics factor for improving prediction of performance during computer-based testing. Our initial results are encouraging and indicate that the temporal dimension of learning analytics should be further explored.

[1]  Anastasios A. Economides,et al.  Prediction of student's mood during an online test using formula-based and neural network-based method , 2009, Comput. Educ..

[2]  Paul R. Cohen,et al.  Temporal Data Mining for Educational Applications , 2008, Int. J. Softw. Informatics.

[3]  Wu He,et al.  Using Data Mining for Predicting Relationships between Online Question Theme and Final Grade , 2012, J. Educ. Technol. Soc..

[4]  F. Bookstein,et al.  Two Structural Equation Models: LISREL and PLS Applied to Consumer Exit-Voice Theory , 1982 .

[5]  John Hulland,et al.  Use of partial least squares (PLS) in strategic management research: a review of four recent studies , 1999 .

[6]  Anastasios A. Economides,et al.  The acceptance and use of computer based assessment , 2011, Comput. Educ..

[7]  Liwen Chen,et al.  Improving student performance in a first-year geography course: Examining the importance of computer-assisted formative assessment , 2011, Comput. Educ..

[8]  Deborah Compeau,et al.  Social Cognitive Theory and Individual Reactions to Computing Technology: A Longitudinal Study , 1999, MIS Q..

[9]  Anastasios A. Economides,et al.  Adaptive context-aware pervasive and ubiquitous learning , 2009 .

[10]  Elena Karahanna,et al.  Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage , 2000, MIS Q..

[11]  Anastasios A. Economides,et al.  How student's personality traits affect Computer Based Assessment Acceptance: Integrating BFI with CBAAM , 2012, Comput. Hum. Behav..

[12]  Sarath A. Nonis,et al.  Academic Performance of College Students: Influence of Time Spent Studying and Working , 2006 .

[13]  Wynne W. Chin.  The partial least squares approach for structural equation modeling. , 1998 .

[14]  Chenn-Jung Huang,et al.  Implementation and performance evaluation of parameter improvement mechanisms for intelligent e-learning systems , 2007, Comput. Educ..

[15]  Abigail Selzer King,et al.  Using Signals for appropriate feedback: Perceptions and practices , 2011, Comput. Educ..

[16]  R. Frank Falk,et al.  A Primer for Soft Modeling , 1992 .

[17]  Anastasios A. Economides.  Adaptive Orientation Methods in Computer Adaptive Testing , 2005 .

[18]  Y. Chen.  [The change of serum alpha 1-antitrypsin level in patients with spontaneous pneumothorax]. , 1995, Zhonghua jie he he hu xi za zhi = Zhonghua jiehe he huxi zazhi = Chinese journal of tuberculosis and respiratory diseases.

[19]  Jacob Cohen.  Statistical Power Analysis , 1992 .

[20]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[21]  Zachary A. Pardos,et al.  Affective states and state tests: investigating how affect throughout the school year predicts end of year learning outcomes , 2013, LAK '13.

[22]  Anastasios A. Economides,et al.  Computer based assessment: Gender differences in perceptions and acceptance , 2011, Comput. Hum. Behav..

[23]  Anastasios A. Economides,et al.  Towards the alignment of computer-based assessment outcome with learning goals: The LAERS architecture , 2013, 2013 IEEE Conference on e-Learning, e-Management and e-Services.

[24]  Stephen Fancsali,et al.  Variable construction for predictive and causal modeling of online education data , 2011, LAK.

[25]  Zdenek Zdráhal,et al.  Improving retention: predicting at-risk students by analysing clicking behaviour in a virtual learning environment , 2013, LAK '13.