A survey on adaptive qualitative assessment and dynamic questions generation approaches

The goal of assessment is to identify weaknesses in learner's knowledge. There are various types of assessment in which among them are the Quantitative and Qualitative assessment. This paper is concerned with the qualitative assessment. The underlying principle of qualitative assessment motivates the research. Qualitative assessment is not about assessing the domain knowledge but it is about assessing the learner's current and potential capacities related to the knowledge. Dynamic questions generation for qualitative assessment involves a strong degree of subjectiveness. Appropriate scoring mechanism is needed to assess learner's level of knowledge and to dynamically create a subjective question that is adaptive to the learner's current knowledge and understanding. The paper provides an overview of adaptive qualitative assessment and dynamic questions generation and a discussion on possible approaches found in the recent research as a guide to the development of an automated tool.

[1]  Liew Chee Sun.  IOAS: An Intelligent Online Assessment System , 2007 .

[2]  Hiroshi Nakagawa,et al.  A Real-Time Multiple-Choice Question Generation For Language Testing: A Preliminary Study , 2005 .

[3]  M. Araceli Ruiz-Primo,et al.  Examining Concept Maps as an Assessment Tool , 2004 .

[4]  J. Emig.  Writing as a Mode of Learning. , 1977 .

[5]  Klaus Zechner,et al.  Automated Essay Scoring: Writing Assessment and Instruction , 2010 .

[6]  Tristan Miller,et al.  Essay Assessment with Latent Semantic Analysis , 2003 .

[7]  Marco Pedroni,et al.  Concept Maps as a Learning Assessment Tool , 2007 .

[8]  Peter W. Foltz,et al.  The intelligent essay assessor: Applications to educational technology , 1999 .

[9]  Yen-Ting Lin,et al.  Dynamic question generation system for web-based testing using particle swarm optimization , 2009, Expert Syst. Appl..

[10]  Salvatore Valenti,et al.  An Overview of Current Research on Automated Essay Grading , 2003, J. Inf. Technol. Educ..

[11]  Liana Stanescu,et al.  Question generation for learning evaluation , 2008, 2008 International Multiconference on Computer Science and Information Technology.

[12]  Ismael Pascual-Nieto,et al.  Natural Language Processing meets User Modeling for automatic and adaptive free-text scoring , 2008, Proces. del Leng. Natural.

[13]  Tao Li,et al.  Automatically Generating Questions in Multiple Variables for Intelligent Tutoring , 2005 .

[14]  Kyparisia A. Papanikolaou,et al.  Compass: An Adaptive Web-Based Concept Map Assessment Tool , 2004 .

[15]  Di Challis,et al.  Committing to quality learning through adaptive online assessment , 2005 .

[16]  Ismael Pascual-Nieto,et al.  Willow: Automatic and Adaptive Assessment of Students' Free-text Answers , 2006, Proces. del Leng. Natural.

[17]  Thomas A. Angelo,et al.  Classroom Assessment Techniques: A Handbook for College Teachers. Second Edition. , 1993 .

[18]  Kenji Kaijiri,et al.  Design Overview of an Adaptive Computer-based Assessment System , 2007 .

[19]  Janis Grundspenkis,et al.  Using Concept Maps in Adaptive Knowledge Assessment , 2007 .

[20]  Martin Chodorow,et al.  C-rater: Automated Scoring of Short-Answer Questions , 2003, Comput. Humanit..