Participatory Learner Modelling Design: A methodology for iterative learner models development

Learner models are built to offer personalised solutions related to learning. They are often developed in parallel to the development of adaptive learning systems and thus, linked to the system's development. The adaptive learning systems literature reports numerous accounts of learner model development, but there are no reports on the methodological aspects of developing learner models and the relation between the development of the learner model component and the rest of the system. This paper presents the Participatory Learner Modelling Design methodology, which outlines the steps for learner model development and their relation to the development of the system. The methodology is illustrated with a case study of an adaptive educational system.

[1]  Victor R. Basili,et al.  Iterative and incremental developments. a brief history , 2003, Computer.

[2]  Kentaro Go,et al.  The blind men and the elephant: views of scenario-based system design , 2004, INTR.

[3]  Andrew Sears,et al.  Human-Computer Interaction: Development Process , 2009 .

[4]  Federica Cena,et al.  User model interoperability: a survey , 2011, User Modeling and User-Adapted Interaction.

[5]  Yvonne Rogers,et al.  Kids as informants: telling us what we didn't know or confirming what we knew already? , 1998 .

[6]  Susanne Bødker,et al.  Scenarios in user-centred design-setting the stage for reflection and action , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[7]  Sara Bernardini,et al.  Designing an Intelligent Partner for Social Communication in Autism , 2013, AAAI 2013.

[8]  V. Holmes,et al.  Data-Driven Intervention: Correcting Mathematics Students' Misconceptions, not Mistakes , 2013 .

[9]  Lawrence Tagg.  Services , 1987 .

[10]  Judith Good,et al.  CARSS: A Framework for Learner-Centred Design with Children , 2006, Int. J. Artif. Intell. Educ..

[11]  Alexandra Poulovassilis,et al.  The design of a system to support exploratory learning of algebraic generalisation , 2012, Comput. Educ..

[12]  Xingshe Zhou,et al.  TV Program Recommendation for Multiple Viewers Based on user Profile Merging , 2006, User Modeling and User-Adapted Interaction.

[13]  Susan Bull,et al.  Assessing English as a Second Language: From Classroom Data to a Competence-Based Open Learner Model. , 2012 .

[14]  Tom Gross,et al.  Workshop on group recommender systems: Concepts, technology, evaluation (groupRS) , 2013 .

[15]  Etienne Wenger,et al.  Artificial Intelligence and Tutoring Systems: Computational and Cognitive Approaches to the Communication of Knowledge , 1987 .

[16]  Arthur C. Graesser,et al.  AUTOMATIC DETECTION OF LEARNER'S AFFECT FROM GROSS BODY LANGUAGE , 2009, Appl. Artif. Intell..

[17]  George D. Magoulas,et al.  Fuzzy Inference for Student Diagnosis in Adaptive Educational Hypermedia , 2002, SETN.

[18]  Pankaj Jalote,et al.  Timeboxing: a process model for iterative software development , 2004, J. Syst. Softw..

[19]  Pierluigi Ritrovato,et al.  SERVICES, SEMANTICS, AND STANDARDS: ELEMENTS OF A LEARNING GRID INFRASTRUCTURE , 2005, Appl. Artif. Intell..

[20]  Konstantina Chrysafiadi,et al.  Student modeling approaches: A literature review for the last decade , 2013, Expert Syst. Appl..

[21]  Barry Smyth,et al.  Recommendation to Groups , 2007, The Adaptive Web.

[22]  Antonija Mitrovic,et al.  Fifteen years of constraint-based tutors: what we have achieved and where we are going , 2011, User Modeling and User-Adapted Interaction.

[23]  C. Hoyles,et al.  Visual and Symbolic Reasoning in Mathematics: Making Connections with Computers? , 1999 .

[24]  Bernd Brügge,et al.  User involvement in software evolution practice: A case study , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[25]  Bonnie A. Nardi,et al.  The use of scenarios in design , 1992, SGCH.

[26]  R Bernabei,et al.  Designing together: end-user collaboration in designing a personalised product , 2013 .

[27]  Peter Brusilovsky,et al.  Student model centered architecture for intelligent learning environments , 1994 .

[28]  Gabriel-Miro Muntean,et al.  Quality of Experience-LAOS: create once, use many, use anywhere , 2007, Int. J. Learn. Technol..

[29]  Derek H. Sleeman,et al.  UMFE: A User Modelling Front-End Subsystem , 1985, Int. J. Man Mach. Stud..

[30]  Allison Druin,et al.  Cooperative inquiry: developing new technologies for children with children , 1999, CHI '99.

[31]  Morten Hertzum,et al.  Making use of scenarios: a field study of conceptual design , 2003, Int. J. Hum. Comput. Stud..

[32]  Kostas Stefanidis,et al.  Contextual Recommendations for Groups , 2012, ER Workshops.

[33]  Darina Dicheva,et al.  Ontological technologies for user modelling , 2010, Int. J. Metadata Semant. Ontologies.

[34]  Moira C. Norrie,et al.  W3touch: metrics-based web page adaptation for touch , 2013, CHI.

[35]  Alexandra I. Cristea,et al.  LAOS: Layered WWW AHS Authoring Model and their corresponding Algebraic Operators , 2003 .

[36]  Nancy J. Cooke,et al.  Knowledge Elicitation , 2003 .

[37]  Sara Bernardini,et al.  Proceedings of the Ninth Annual AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment , 2013, AAAI 2013.

[39]  Mark Guzdial,et al.  Learner-centered design: the challenge for HCI in the 21st century , 1994, INTR.

[40]  Vincent P. Wade,et al.  Authoring and Delivering Personalised Simulations - an Innovative Approach to Adaptive eLearning for Soft Skills , 2010, J. Univers. Comput. Sci..

[41]  Luis Francisco-Revilla,et al.  Netflix recommendations for groups , 2010, ASIST.

[42]  Cristina Conati,et al.  Knowledge Elicitation Methods for Affect Modelling in Education , 2013, Int. J. Artif. Intell. Educ..

[43]  Marcus Specht,et al.  Personalization and Context Management , 2005, User Modeling and User-Adapted Interaction.

[44]  Craig D. B. Boyle,et al.  Metadoc: An adaptive hypertext reading system , 1994, User Modeling and User-Adapted Interaction.

[45]  Cristina Conati,et al.  Using Bayesian Networks to Manage Uncertainty in Student Modeling , 2002, User Modeling and User-Adapted Interaction.

[46]  Sidney K. D'Mello,et al.  A Review and Meta-Analysis of Multimodal Affect Detection Systems , 2015, ACM Comput. Surv..

[47]  Eleni E. Mangina,et al.  Utilizing vector space models for user modeling within e-learning environments , 2008, Comput. Educ..

[48]  Rosa M. Carro,et al.  Advances in Authoring of Adaptive Web-based Systems , 2010, J. Univers. Comput. Sci..

[49]  Niall Winters,et al.  IDR: A participatory methodology for interdisciplinary design in technology enhanced learning , 2008, Comput. Educ..

[50]  Russell G. Almond,et al.  You Can't Fatten A Hog by Weighing It - Or Can You? Evaluating an Assessment for Learning System Called ACED , 2008, Int. J. Artif. Intell. Educ..

[51]  Laurence Brooks,et al.  Fuzzy cognitive map modelling educational software adoption , 2008, Comput. Educ..

[52]  Susan Craw,et al.  Case-Based Reasoning , 2010, Encyclopedia of Machine Learning.

[53]  Allison Druin,et al.  The role of children in the design of new technology , 2002 .

[54]  Constantine D. Spyropoulos,et al.  Exploiting learning techniques for the acquisition of user stereotypes and communities , 1999 .

[55]  Stephan Weibelzahl,et al.  Using MotSaRT to Support On-Line Teachers in Student Motivation , 2007, EC-TEL.

[56]  George D. Magoulas,et al.  Hybrid model for learner modelling and feedback prioritisation in exploratory learning , 2009, Int. J. Hybrid Intell. Syst..

[57]  Tobias Baur,et al.  Modelling Users' Affect in Job Interviews: Technological Demo , 2013, UMAP.

[58]  David Benyon,et al.  Applying user modeling to human-computer interaction design , 1993, Artificial Intelligence Review.

[59]  Mihaela Cocea,et al.  Predicting Students' Emotions Using Machine Learning Techniques , 2015, AIED.

[60]  Judith Masthoff,et al.  Group Recommender Systems: Combining Individual Models , 2011, Recommender Systems Handbook.

[61]  Alfred Kobsa,et al.  Generic User Modeling Systems , 2001, User Modeling and User-Adapted Interaction.

[62]  Peter Brusilovsky,et al.  Adaptive Hypermedia , 2001, User Modeling and User-Adapted Interaction.

[63]  Manolis Mavrikis,et al.  Not all wizards are from Oz: Iterative design of intelligent learning environments by communication capacity tapering , 2010, Comput. Educ..

[64]  Mihaela Cocea,et al.  Disengagement Detection in Online Learning: Validation Studies and Perspectives , 2011, IEEE Transactions on Learning Technologies.

[65]  I. Foster,et al.  The Physiology of the Grid , 2003 .

[66]  Manolis Mavrikis,et al.  A Separation of Concerns for Engineering Intelligent Support for Exploratory Learning Environments , 2012 .

[67]  Munindar P. Singh,et al.  Service-Oriented Computing: Key Concepts and Principles , 2005, IEEE Internet Comput..

[68]  Ivica Crnkovic,et al.  Component-based development process and component lifecycle , 2005, 27th International Conference on Information Technology Interfaces, 2005..

[69]  Manolis Mavrikis,et al.  Issues in the Design of an Environment to Support the Learning of Mathematical Generalisation , 2008, EC-TEL.

[70]  Boris Brandherm,et al.  Gumo - The General User Model Ontology , 2005, User Modeling.

[71]  Johan Bollen.  Group User Models for Personalized Hyperlink Recommendations , 2000, AH.

[72]  Peter Brusilovsky,et al.  User Models for Adaptive Hypermedia and Adaptive Educational Systems , 2007, The Adaptive Web.

[73]  George D. Magoulas,et al.  Case-based reasoning approach to adaptive modelling in exploratory learning , 2012 .

[74]  Tobias Baur,et al.  Interpreting social cues to generate credible affective reactions of virtual job interviewers , 2014, ArXiv.

[75]  Alfred Kobsa,et al.  Interaction of domain expertise and interface design in adaptive educational hypermedia , 1999 .

[76]  Robert M. Haralick,et al.  Feature normalization and likelihood-based similarity measures for image retrieval , 2001, Pattern Recognit. Lett..

[77]  George D. Magoulas,et al.  User behaviour-driven group formation through case-based reasoning and clustering , 2012, Expert Syst. Appl..

[78]  Helen Pain,et al.  Persistent collaboration: a methodology for applied AIED , 1996 .

[79]  Franck Tarpin-Bernard,et al.  Modeling Elementary Cognitive Abilities for Adaptive Hypermedia Presentation , 2005, User Modeling and User-Adapted Interaction.

[80]  Geert-Jan Houben,et al.  Cross-system user modeling and personalization on the Social Web , 2013, User Modeling and User-Adapted Interaction.

[81]  Elliot Soloway,et al.  Learning theory in practice: case studies of learner-centered design , 1996, CHI.

[82]  Zoran Budimac,et al.  E-Learning personalization based on hybrid recommendation strategy and learning style identification , 2011, Comput. Educ..

[83]  H Hongjing Wu,et al.  A reference architecture for adaptive hypermedia applications , 2002 .

[84]  Michel C. Desmarais,et al.  A review of recent advances in learner and skill modeling in intelligent learning environments , 2012, User Modeling and User-Adapted Interaction.

[85]  Theo Tryfonas,et al.  Frontiers in Artificial Intelligence and Applications , 2009 .

[86]  Changchun Liu,et al.  Online Affect Detection and Robot Behavior Adaptation for Intervention of Children With Autism , 2008, IEEE Transactions on Robotics.

[87]  Ian Sommerville,et al.  Requirements Engineering: Processes and Techniques , 1998 .

[88]  Mihaela Cocea,et al.  Log file analysis for disengagement detection in e-Learning environments , 2009, User Modeling and User-Adapted Interaction.

[89]  Peter Brusilovsky,et al.  The Value of Adaptivity in Hypermedia Learning Environments: A Short Review of Empirical Evidence , 2004 .

[90]  Cristina Conati,et al.  Probabilistic assessment of user's emotions in educational games , 2002, Appl. Artif. Intell..

[91]  Ricardo Conejo,et al.  A Learner Model in a Distributed Environment , 2004, AH.

[92]  Peter Brusilovsky,et al.  A Framework for Intelligent Knowledge Sequencing and Task Sequencing , 1992, Intelligent Tutoring Systems.

[93]  Lisa N. Michaud,et al.  Empirical Derivation of a Sequence of User Stereotypes for Language Learning , 2004, User Modeling and User-Adapted Interaction.