Individualization for Education at Scale: MIIC Design and Preliminary Evaluation

We present the design, implementation, and preliminary evaluation of our Adaptive Educational System (AES): the Mobile Integrated and Individualized Course (MIIC). MIIC is a platform for personalized course delivery which integrates lecture videos, text, assessments, and social learning into a mobile native app, and collects clickstream-level behavioral measurements about each student as they interact with the material. These measurements can subsequently be used to update the student's user model, which can in turn be used to determine the content adaptation. Recruiting students from one of our Massive Open Online Courses (MOOCs), we have conducted two preliminary trials with MIIC, in which we found (i) that the majority of students (70 percent) preferred MIIC overall to a one-size-fits-all (OSFA) presentation of the same material, (ii) that the mean level of engagement, when quantified as the number of pages viewed, was statistically higher (by 72 percent) among students using MIIC than among OSFA, and (iii) that the integrated multimedia learning features were generally favorable among the students (e.g., 87 percent found the videos helpful).

[1]  Yavuz Akbulut,et al.  Adaptive educational hypermedia accommodating learning styles: A content analysis of publications from 2000 to 2011 , 2012, Comput. Educ..

[2]  Jürgen Bock,et al.  Personalized Web Learning: Merging Open Educational Resources into Adaptive Courses for Higher Education , 2014, UMAP Workshops.

[3]  Francisco José García-Peñalvo.  Proceedings of the First International Conference on Technological Ecosystem for Enhancing Multiculturality , 2013 .

[4]  Bilge Mutlu,et al.  ARTFul: adaptive review technology for flipped learning , 2013, CHI.

[5]  Carla Limongelli,et al.  Adaptive Learning with the LS-Plan System: A Field Evaluation , 2009, IEEE Transactions on Learning Technologies.

[6]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[7]  Natalia Stash,et al.  Creating and Delivering Adaptive Courses with AHA! , 2006, EC-TEL.

[8]  Shun Han Rebekah Wong.  Which platform do our users prefer: website or mobile app? , 2012 .

[9]  Mehran Sahami,et al.  Proceedings of the first ACM conference on Learning @ scale conference , 2014 .

[10]  Ines Gloeckner.  Networked Life 20 Questions And Answers , 2016 .

[11]  Ming-Puu Chen,et al.  An evaluation of learners' satisfaction toward mobile learning , 2007 .

[12]  Luo Si,et al.  Automatic Detection of Off-Task Behaviors in Intelligent Tutoring Systems with Machine Learning Techniques , 2010, IEEE Transactions on Learning Technologies.

[13]  Tony Fisher,et al.  Real users, real results: examining the limitations of learning styles within AEH , 2007, HT '07.

[14]  Antoine Doucet,et al.  Building engagement for MOOC students: introducing support for time management on online learning platforms , 2014, WWW.

[15]  Maliha S. Nash,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 2001, Technometrics.

[16]  R. Dunn.  UNDERSTANDING THE DUNN AND DUNN LEARNING STYLES MODEL AND THE NEED FOR INDIVIDUAL DIAGNOSIS AND PRESCRIPTION , 1990 .

[17]  D. Suthers,et al.  Proceedings of the Third International Conference on Learning Analytics and Knowledge , 2013, LAK 2013.

[18]  Peter Brusilovsky,et al.  ELM-ART: An Adaptive Versatile System for Web-based Instruction , 2001 .

[19]  Doug Clow,et al.  MOOCs and the funnel of participation , 2013, LAK '13.

[20]  Tony Fisher,et al.  Real users, real results: examining the limitations of learning styles within AEH , 2007, SIGWEB Newsl..

[21]  Richard G. Baraniuk,et al.  Tag-Aware Ordinal Sparse Factor Analysis for Learning and Content Analytics , 2014, EDM.

[22]  Scott P. Robertson,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 1991 .

[23]  David B. Daniel,et al.  E-books or textbooks: Students prefer textbooks , 2010, Comput. Educ..

[24]  Michael Jahrer,et al.  Collaborative Filtering Applied to Educational Data Mining , 2010 .

[25]  Gerhard Weber,et al.  User Modeling and Adaptive Navigation Support in WWW-Based Tutoring Systems , 1997 .

[26]  Kyle Bowen,et al.  Student Preferences for Mobile App Usage , 2012 .

[27]  R. Felder,et al.  Learning and Teaching Styles in Engineering Education. , 1988 .

[28]  Mohamed Jemni,et al.  Learning Technologies , 2002 .

[29]  Yoav Bergner,et al.  Model-Based Collaborative Filtering Analysis of Student Response Data: Machine-Learning Item Response Theory , 2012, EDM.

[30]  Azuka N. G. Alutu,et al.  The Guidance Role of the Instructor in the Teaching and Learning Process. , 2006 .

[31]  N. Heffernan,et al.  Using HMMs and bagged decision trees to leverage rich features of user and skill from an intelligent tutoring system dataset , 2010 .

[32]  George D. Kuh,et al.  Student Engagement and Student Learning: Testing the Linkages* , 2006 .

[33]  Rosa M. Carro,et al.  Supporting the Development of Mobile Adaptive Learning Environments: A Case Study , 2009, IEEE Transactions on Learning Technologies.

[34]  Claus Pahl,et al.  Constraint-Based Validation of Adaptive e-Learning Courseware , 2009, IEEE Transactions on Learning Technologies.

[35]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[36]  Peter Brusilovsky,et al.  Methods and techniques of adaptive hypermedia , 1996, User Modeling and User-Adapted Interaction.

[37]  Lars Schmidt-Thieme,et al.  Using factorization machines for student modeling , 2012, UMAP Workshops.

[38]  A. Astin.  Student involvement: A developmental theory for higher education. , 1999 .

[39]  Tony Fisher,et al.  Evaluating Learning Style Personalization in Adaptive Systems: Quantitative Methods and Approaches , 2009, IEEE Transactions on Learning Technologies.

[40]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[41]  Alfred Kobsa.  User Modeling and User-Adapted Interaction , 2005, User Modeling and User-Adapted Interaction.

[42]  Verena D. Schmittmann,et al.  Multiple learning modes in the development of performance on a rule-based category-learning task , 2006, Neuropsychologia.

[43]  Tony Fisher,et al.  Reappraising cognitive styles in adaptive web applications , 2006, WWW '06.

[44]  Zhenming Liu,et al.  Learning about Social Learning in MOOCs: From Statistical Analysis to Generative Model , 2013, IEEE Transactions on Learning Technologies.

[45]  Michael McAleer,et al.  A Trinomial Test for Paired Data When There are Many Ties , 2009, Math. Comput. Simul..

[46]  Carolyn Penstein Rosé,et al.  “ Turn on , Tune in , Drop out ” : Anticipating student dropouts in Massive Open Online Courses , 2013 .

[47]  Mung Chiang,et al.  Social learning networks: A brief survey , 2014, 2014 48th Annual Conference on Information Sciences and Systems (CISS).

[48]  Nishikant Sonwalkar,et al.  The First Adaptive MOOC: A Case Study on Pedagogy Framework and Scalable Cloud Architecture—Part I , 2013 .

[49]  Chris Piech,et al.  Deconstructing disengagement: analyzing learner subpopulations in massive open online courses , 2013, LAK '13.

[50]  Krzysztof Z. Gajos,et al.  Understanding in-video dropouts and interaction peaks in online lecture videos Citation , 2014 .

[51]  Jay F. Nunamaker,et al.  Instructional video in e-learning: Assessing the impact of interactive video on learning effectiveness , 2006, Inf. Manag..

[52]  Francisco J. García-Peñalvo,et al.  A methodology proposal for developing adaptive cMOOC , 2013, TEEM '13.