Examining Learning Experience in Two Online Courses Using Web Logs and Experience Sampling Method (ESM)

Web mining and visualization techniques are used to discover the underlying patterns of online learning experience. Yet, the analytics are often limited to merely behavioral data lacking other critical dimensions that form an important part of the learning experience such as learners’ cognitive involvement and emotional experience. Therefore, it is critical to find a method that can capture a holistic online learning experience while a learner progresses in an online course. This chapter introduces the Experience Sampling Method (ESM) that can be used to supplement Web Log Analysis (WLA) by collecting data on learners’ cognitive involvement and emotion in each learning task. Then this chapter reports a case study of utilizing the ESM and WLA to examine online learning experiences in a discussion-focused online course and a design-/development-focused online course. Lastly, a visualized learning experience dashboard is presented to show an individual learner's learning experience based upon the three dimensions of learning experience.

[1]  Alon Peled,et al.  Logging for Success: Advancing the Use of WWW Logs to Improve Computer Mediated Distance Learning , 1999 .

[2]  Linda M. Harasim,et al.  Learning Theory and Online Technologies , 2011 .

[3]  Sebastián Ventura,et al.  Data mining in course management systems: Moodle case study and tutorial , 2008, Comput. Educ..

[4]  Vishal Mahajan,et al.  Usage patterns discovery from a web log in an Indian e-learning site: A case study , 2014, Education and Information Technologies.

[5]  Robert M. Bernard,et al.  Are contextual and designed student–student interaction treatments equally effective in distance education? , 2012 .

[6]  Cesar C. Navarrete,et al.  Online social networks as formal learning environments: Learner experiences and activities , 2012 .

[7]  Russell T. Hurlburt,et al.  Random sampling of cognitions and behavior , 1979 .

[8]  I. Kazanidis,et al.  E-Learning Platform Usage Analysis , 2011 .

[9]  F. Paas,et al.  Variability of Worked Examples and Transfer of Geometrical Problem-Solving Skills: A Cognitive-Load Approach , 1994 .

[10]  I. E. Allen,et al.  Grade Change: Tracking Online Education in the United States. , 2014 .

[11]  Reginald S. Lee,et al.  Student Engagement in U.S. Urban High School Mathematics and Science Classrooms: Findings on Social Organization, Race, and Ethnicity , 2007 .

[12]  M. Csíkszentmihályi,et al.  Experience Sampling Method: Measuring the Quality of Everyday Life , 2006 .

[13]  Joel M. Hektner,et al.  Experience sampling method , 2007 .

[14]  Jodi Forlizzi,et al.  The building blocks of experience: an early framework for interaction designers , 2000, DIS '00.

[15]  T. Trull,et al.  Ecological momentary assessment of mood disorders and mood dysregulation. , 2009, Psychological assessment.

[16]  A. Delle Fave,et al.  Quality of experience during psychosocial rehabilitation: a real-time investigation with experience sampling method. , 2012, Psychiatric rehabilitation journal.

[17]  P. Cowan,et al.  Using Activity Theory to Problematize the Role of the Teacher During Mobile Learning , 2013 .

[18]  Alyssa Friend Wise,et al.  Learning Analytics for Online Discussions: Embedded and Extracted Approaches , 2014, J. Learn. Anal..

[19]  Laurie P. Dringus,et al.  Using data mining as a strategy for assessing asynchronous discussion forums , 2005, Comput. Educ..

[20]  G. Veletsianos,et al.  Long-term student experiences in a hybrid, open-ended and problem based Adventure Learning program , 2010 .

[21]  Mark J. W. Lee,et al.  Personalised and Self Regulated Learning in the Web 2.0 Era: International Exemplars of Innovative Pedagogy Using Social Software. , 2010 .

[22]  L. F. Barrett.  Discrete Emotions or Dimensions? The Role of Valence Focus and Arousal Focus , 1998 .

[23]  Andy P. Field,et al.  Discovering Statistics Using Ibm Spss Statistics , 2017 .

[24]  Peter Shea,et al.  Does online learning impede degree completion? A national study of community college students , 2014, Comput. Educ..

[25]  Vajirasak Vanijja,et al.  Statistical Analysis Of eLearning Usage In An University , 2006 .

[26]  Gail A. Herndon.  The chronicle of higher education , 1977 .

[27]  Jason Cole,et al.  Using Moodle - teaching with the popular open source course management system , 2007 .

[28]  N. Nachar.  The Mann ‐ Whitney U: A Test for Assessing Whether Two Independent Samples Come from the Same Distribution , 2007 .

[29]  F. Paas,et al.  A motivational perspective on the relation between mental effort and performance: Optimizing learner involvement in instruction , 2005 .

[30]  V. Maheswari,et al.  Web Log Data Analysis and Mining , 2011 .

[31]  Doug Clow,et al.  The learning analytics cycle: closing the loop effectively , 2012, LAK.

[32]  Kathleen E. Cox,et al.  Creating Contexts for Involvement in Mathematics. , 1998 .

[33]  Lori B. Holcomb,et al.  The Use of Alternative Social Networking Sites in Higher Educational Settings: A Case Study of the E-Learning Benefits of Ning in Education , 2010 .

[34]  Jason Huett,et al.  The Evolution of Distance Education: Implications for Instructional Design on the Potential of the Web , 2008 .