The Gain-Loss Model: A formal model for assessing learning processes

The thesis presents the Gain-Loss Model, a formal model for assessing learning processes. The theoretical framework is knowledge space theory, which is a novel approach to the assessment of knowledge proposed by Doignon and Falmagne in 1985. The Gain-Loss Model assesses the knowledge of students in the different steps of the learning process, and the effectiveness of educational interventions in promoting specific learning. The core element is represented by a skill multimap associating each problem with a collection of subsets of skills that are necessary and sufficient to solve it. The model is characterized by parameters which provide information relevant at different levels of didactic practice. The model has been the subject of investigation at different levels. Its functioning has been analyzed under different conditions, and theoretical developments have been proposed for improving its informative power in practical applications. The investigations have been conducted through simulated studies and empirical applications. The thesis presents the work completed on the model. On one hand, the theoretical development of the model itself, as well as some extensions of it, are described. On the other hand, the results of the simulation studies and the empirical applications are presented and discussed.

[1]  Jürgen Heller,et al.  Distributed skill functions and the meshing of knowledge structures , 2008 .

[2]  C. Dowling On the irredundant generation of knowledge spaces , 1993 .

[3]  Jean-Claude Falmagne,et al.  Spaces for the Assessment of Knowledge , 1985, Int. J. Man Mach. Stud..

[4]  Ali Ünlü,et al.  Inductive item tree analysis: Corrections, improvements, and comparisons , 2009, Math. Soc. Sci..

[5]  R. Glaser,et al.  Knowing What Students Know: The Science and Design of Educational Assessment , 2001 .

[6]  Paul F. Lazarsfeld,et al.  Latent Structure Analysis. , 1969 .

[7]  J. Pannekoek,et al.  Bootstrapping Goodness-of-Fit Measures in Categorical Data Analysis , 1996 .

[8]  Jean-Paul Doignon,et al.  A class of stochastic procedures for the assessment of knowledge. , 1988 .

[9]  Mark Levene,et al.  Cognitive Aspects of Trails: A Stochastic Model Linking Navigation Behaviour to the Learner’s Cognitive State , 2007 .

[10]  Mathieu Koppen,et al.  How to build a knowledge space by querying an expert , 1990 .

[11]  Gerhard H. Fischer,et al.  "Contributions to Mathematical Psychology, Psychometrics, and Methodology" , 1993 .

[12]  Martin Schrepp,et al.  A Method for the Analysis of Hierarchical Dependencies between Items of a Questionnaire , 2003 .

[13]  Jimmy de la Torre,et al.  An Empirically Based Method of Q‐Matrix Validation for the DINA Model: Development and Applications , 2008 .

[14]  Dietrich Albert,et al.  Competence-based Knowledge Structures for Personalised Learning , 2005, ELeGI Conference.

[15]  Jeffrey A Douglas,et al.  Higher-order latent trait models for cognitive diagnosis , 2004 .

[16]  Luca Stefanutti,et al.  Assessing learning processes with the gain-loss model , 2011, Behavior research methods.

[17]  E. Maris Estimating multiple classification latent class models , 1999 .

[18]  Brenda Sugrue,et al.  The Lack of Fidelity between Cognitively Complex Constructs and Conventional Test Development Practice. , 2005 .

[19]  Klaus Korossy,et al.  Modeling Knowledge as Competence and Performance , 1999 .

[20]  Susy Macqueen,et al.  Validity , 1973, Just Algorithms.

[21]  Jean-Claude Falmagne,et al.  Knowledge assessment: tapping human expertise by the QUERY routine , 1994, Int. J. Hum. Comput. Stud..

[22]  Martin Schrepp On the empirical construction of implications between bi-valued test items , 1999 .

[23]  Mathieu Koppen,et al.  Introduction to knowledge spaces: How to build, test, and search them , 1990 .

[24]  Jean-Paul Doignon,et al.  A Markovian procedure for assessing the state of a system , 1988 .

[25]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[26]  Luca Stefanutti,et al.  Recovering a Probabilistic Knowledge Structure by Constraining its Parameter Space , 2009 .

[27]  Jean-Claude Falmagne,et al.  The Assessment of Knowledge, in Theory and in Practice , 2006, ICFCA.

[28]  L. Stefanutti A logistic approach to knowledge structures , 2006 .

[29]  Clifford C. Clogg,et al.  Some latent structure models for the analysis of likert-type data , 1979 .

[30]  B. Junker,et al.  Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response Theory , 2001 .

[31]  Jean-Claude Falmagne,et al.  Knowledge spaces , 1998 .

[32]  D. Albert,et al.  Establishing knowledge spaces by systematical problem construction , 1994 .

[33]  A. Agresti An introduction to categorical data analysis , 1997 .

[34]  Keam-Claude Falmagne,et al.  A latent trait theory via a stochastic learning theory for a knowledge space , 1989 .

[35]  Anthony V. Fiacco,et al.  Nonlinear programming;: Sequential unconstrained minimization techniques , 1968 .

[36]  R. Linn Educational measurement, 3rd ed. , 1989 .

[37]  S. Messick Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[38]  Jean-Claude Falmagne,et al.  Stochastic learning paths in a knowledge structure , 1993 .

[39]  B. Lindsay,et al.  Semiparametric Estimation in the Rasch Model and Related Exponential Response Models, Including a Simple Latent Class Model for Item Analysis , 1991 .

[40]  Luca Stefanutti,et al.  IDENTIFIABILITY AND GOODNESS OF RECOVERY IN THE CONSTRAINED GAIN-LOSS MODEL , 2010 .

[41]  Clifford C. Clogg,et al.  Handbook of statistical modeling for the social and behavioral sciences , 1995 .

[42]  Kamakshi Lakshminarayan,et al.  Mapping students’ thinking patterns by the use of the knowledge space theory , 1997 .

[43]  Jean-Paul Doignon Knowledge Spaces and Skill Assignments , 1994 .

[44]  Jean-Claude Falmagne,et al.  Learning Spaces: Interdisciplinary Applied Mathematics , 2010 .

[45]  Cosyn,et al.  A Practical Procedure to Build a Knowledge Structure. , 2000, Journal of mathematical psychology.

[46]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[47]  Ivo Düntsch,et al.  Skills and knowledge structures , 1995 .

[48]  Luca Stefanutti,et al.  The Gain-Loss Model: A Probabilistic Skill Multimap Model for Assessing Learning Processes , 2010 .

[49]  A Agresti,et al.  Quasi-symmetric latent class models, with application to rater agreement. , 1993, Biometrics.

[50]  C. Mitchell Dayton,et al.  The Use of Probabilistic Models in the Assessment of Mastery , 1977 .

[51]  Dietrich Albert,et al.  Knowledge Spaces: Theories, Empirical Research, and Applications , 1998 .

[52]  Mathieu Koppen,et al.  Extracting human expertise for constructing knowledge spaces: an algorithm , 1993 .

[53]  Martin Schrepp Explorative analysis of empirical data by boolean analysis of questionnaires , 2002 .

[54]  J.-Cl. Falmagne,et al.  Stochastic Learning Paths — Estimation and Simulation , 1994 .

[55]  Cord Hockemeyer Competence Based Adaptive E – Learning in Dynamic Domains Cord Hockemeyer , 2003 .

[56]  Ivo Düntsch,et al.  Skill set analysis in knowledge structures. , 2002, The British journal of mathematical and statistical psychology.

[57]  Martin Schrepp Extracting knowledge structures from observed data , 1999 .

[58]  Louis V. DiBello,et al.  Guest Editors' Introduction and Overview: IRT‐Based Cognitive Diagnostic Models and Related Methods , 2007 .

[59]  Dietrich Albert,et al.  Chapter 7 Knowledge Assessment Based on Skill Assignment and Psychological Task Analysis1 , 1993 .

[60]  Alan Agresti,et al.  Categorical Data Analysis , 1991, International Encyclopedia of Statistical Science.

[61]  S. Messick Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[62]  Robert J. Mislevy,et al.  The Role of Probability-Based Inference in an Intelligent Tutoring System. , 1995 .

[63]  Jimmy de la Torre,et al.  Model Evaluation and Multiple Strategies in Cognitive Diagnosis: An Analysis of Fraction Subtraction Data , 2008 .

[64]  Stephen J. Wright Primal-Dual Interior-Point Methods , 1997, Other Titles in Applied Mathematics.

[65]  J. Templin,et al.  The Effects of Q-Matrix Misspecification on Parameter Estimates and Classification Accuracy in the DINA Model , 2008 .

[66]  Neil Henry Latent structure analysis , 1969 .