Open Student Models of Core Competencies at the Curriculum Level: Using Learning Analytics for Student Reflection

This paper proposes an approach for developing curriculum-level open student models. This approach entails evaluating student core competencies using the correspondence between courses and core competencies in a competency-based curriculum and students’ taken courses and grades. On the basis of this approach, a curriculum-level, competency-based visualized analytic system, called visualized analytics of core competencies (VACCs), was implemented. Course-competency diagnostic tools, course work performance radar charts, and peer-based ranking tables were developed as part of the VACC analytic system for student reflection and to position their levels of core competencies. These curriculum-level open student models revealed multiple aspects of students’ core competencies by monitoring the quantity and quality of courses taken by students, and evaluating students’ ranks regarding core competencies compared with their classmates and graduates. VACC evaluation was conducted in this paper. The results showed that more than 70% of students reported that VACC helped in reflecting on their core competencies, assisting them in understanding the correspondence between their taken courses and core competencies, and helping them to set goals regarding taking additional courses. In addition, this paper discusses potential analytics and applications of open student models of core competencies.

[1]  Beverly Park Woolf,et al.  Building Intelligent Interactive Tutors: Student-centered Strategies for Revolutionizing E-learning , 2008 .

[2]  Gautam Biswas,et al.  Substitutive competition: Virtual pets as competitive buffers to alleviate possible negative influence on pupils , 2012, Br. J. Educ. Technol..

[3]  Susan Bull,et al.  Visualising Uncertainty for Open Learner Model Users , 2014, UMAP Workshops.

[4]  Gwo-Jen Hwang,et al.  A conceptual map model for developing intelligent tutoring systems , 2003, Comput. Educ..

[5]  Etienne Wenger,et al.  Artificial Intelligence and Tutoring Systems: Computational and Cognitive Approaches to the Communication of Knowledge , 1987 .

[6]  Claus Pahl,et al.  Intelligent and adaptive tutoring for active learning and training environments , 2009, Interact. Learn. Environ..

[7]  Yen-Ting Lin,et al.  Development of a diagnostic system using a testing-based approach for strengthening student prior knowledge , 2011, Comput. Educ..

[8]  Zhi-Hong Chen,et al.  Active Open Learner Models as Animal Companions: Motivating Children to Learn through Interacting with My-Pet and Our-Pet , 2007, Int. J. Artif. Intell. Educ..

[9]  Marie Bienkowski,et al.  Enhancing Teaching and Learning Through Educational Data Mining and Learning Analytics: An Issue Brief , 2012 .

[10]  Claude Frasson,et al.  Intelligent Tutoring Systems: At the Crossroads of Artificial Intelligence and Education , 1990 .

[11]  Susan Bull,et al.  Uncertainty Representation in Visualizations of Learning Analytics for Learners: Current Approaches and Opportunities , 2015, IEEE Transactions on Learning Technologies.

[12]  Chris W. Clegg,et al.  Design engineering competencies: future requirements and predicted changes in the forthcoming decade , 2005 .

[13]  Catherine P. Bradshaw,et al.  Core competencies and the prevention of school failure and early school leaving. , 2008, New directions for child and adolescent development.

[14]  George Siemens,et al.  Learning analytics and educational data mining: towards communication and collaboration , 2012, LAK.

[15]  M Joan Saary,et al.  Radar plots: a useful way for presenting multivariate health care data. , 2008, Journal of clinical epidemiology.

[16]  Tom Routen,et al.  Intelligent Tutoring Systems , 1996, Lecture Notes in Computer Science.

[17]  Doug Clow.  An overview of learning analytics , 2013 .

[18]  Erik Duval,et al.  The student activity meter for awareness and self-reflection , 2012, CHI Extended Abstracts.

[19]  John Self.  Bypassing the intractable problem of student modelling , 1988 .

[20]  Dursun Delen,et al.  Data, information and analytics as services , 2013, Decis. Support Syst..

[21]  Matthew D. Pistilli,et al.  Course signals at Purdue: using learning analytics to increase student success , 2012, LAK.

[22]  Amy L. Reynolds,et al.  Student Affairs Core Competencies: Integrating Multicultural Awareness, Knowledge, and Skills. , 1997 .

[23]  Alexander K. Koch,et al.  Self-Regulation Through Goal Setting , 2011, SSRN Electronic Journal.

[24]  John M. Chambers,et al.  Graphical Methods for Data Analysis , 1983 .

[25]  George D. Magoulas,et al.  Adaptive web-based learning: accommodating individual differences through system's adaptation , 2003, Br. J. Educ. Technol..

[26]  Ulrik Schroeder,et al.  A reference model for learning analytics , 2012 .

[27]  Judy Kay,et al.  Student Models that Invite the Learner In: The SMILI: () Open Learner Modelling Framework , 2007, Int. J. Artif. Intell. Educ..

[28]  Ryan S. Baker,et al.  Educational Data Mining and Learning Analytics , 2014 .

[29]  Jaime R. Carbonell,et al.  AI in CAI : An artificial intelligence approach to computer-assisted instruction , 1970 .

[30]  E. A. Locke,et al.  Self-regulation through goal setting , 1991 .

[31]  Simon Buckingham Shum,et al.  Learning dispositions and transferable competencies: pedagogy, modelling and learning analytics , 2012, International Conference on Learning Analytics and Knowledge.

[32]  Eric G. Hansen,et al.  Evidence-based Approach to Interacting with Open Student Models , 2007, Int. J. Artif. Intell. Educ..

[33]  Antonija Mitrovic,et al.  Fifteen years of constraint-based tutors: what we have achieved and where we are going , 2011, User Modeling and User-Adapted Interaction.

[34]  Bert Bredeweg,et al.  Student Modelling: The Key to Individualized Knowledge-Based Instruction , 2010, NATO ASI Series.

[35]  Françoise Delamare Le Deist,et al.  What Is Competence? , 2005 .

[36]  Marlene Jones,et al.  The State of Student Modelling , 1994 .

[37]  Steven F. Quigley,et al.  Computer-based formative assessment to promote reflection and learner autonomy , 2006 .

[38]  Erik Duval,et al.  Dataset-Driven Research to Support Learning and Knowledge Analytics , 2012, J. Educ. Technol. Soc..

[39]  Peter Brusilovsky,et al.  User Models for Adaptive Hypermedia and Adaptive Educational Systems , 2007, The Adaptive Web.

[40]  Po-Yao Chao,et al.  Negotiation based adaptive learning sequences: Combining adaptivity and adaptability , 2015, Comput. Educ..

[41]  Susan Bull,et al.  Use and Trust of Simple Independent Open Learner Models to Support Learning within and across Courses , 2009, UMAP.

[42]  Antonija Mitrovic,et al.  Evaluating the Effect of Open Student Models on Self-Assessment , 2007, Int. J. Artif. Intell. Educ..

[43]  Carlos Delgado Kloos,et al.  ALAS-KA: A learning analytics extension for better understanding the learning process in the Khan Academy platform , 2015, Comput. Hum. Behav..

[44]  George Siemens,et al.  The Cambridge Handbook of the Learning Sciences: Educational Data Mining and Learning Analytics , 2014 .

[45]  Susan Bull,et al.  Formative Assessment and Meaningful Learning Analytics , 2014, 2014 IEEE 14th International Conference on Advanced Learning Technologies.

[46]  Anthony G. Picciano.  The Evolution of Big Data and Learning Analytics in American Higher Education , 2012 .

[47]  K. Robert Lai,et al.  Enrichment of Peer Assessment with Agent Negotiation , 2011, IEEE Transactions on Learning Technologies.

[48]  Seung Youn Chyung,et al.  Building a Competency-Based Curriculum Architecture to Educate 21st-Century Business Practitioners , 2006 .

[49]  Vania Dimitrova,et al.  CourseVis: A graphical student monitoring tool for supporting instructors in web-based distance courses , 2007, Int. J. Hum. Comput. Stud..

[50]  E. Duval.  Attention please!: learning analytics for visualization and recommendation , 2011, LAK.

[51]  Gwo-Jen Hwang,et al.  Diagnosing student learning problems based on historical assessment records , 2008 .

[52]  Doug Clow,et al.  The learning analytics cycle: closing the loop effectively , 2012, LAK.

[53]  William J. Byrne,et al.  Visualising Multiple Data Sources in an Independent Open Learner Model , 2013, AIED.