The paper describes the developed adaptive system for knowledge assessment and self-assessment based on usage of concept maps. The concept mapping approach offers a reasonable balance between complexity of knowledge assessment system and necessity to assess higher levels of knowledge according to the Bloom's taxonomy. The underlying concepts of the developed system which supports a process oriented learning are discussed. The architecture and functionality of the intelligent knowledge assessment system based on the intelligent agent paradigm is described. The system to the large extent can adapt to each individual learner by changing the degree of task difficulty and providing execution of two kinds of tasks - fill-in tasks and construction tasks of concept maps. Information about two prototypes which have been already implemented and tested in different study courses is given. Nowadays when knowledge society requires high-value workers who produce high-value output, sweeping changes affect the information age education. First, roles of main actors of teaching and learning process have changed. Teachers now should be guides and coaches while passive learners start to turn into active ones. These changes are very strongly promoted by modern information and communication (ICT) technologies which penetrate in education starting from kindergartens and ending with universities and organizations that provide life long education. ICT enables student centered and one-to-one learning in traditional as well as in e- and m-learning settings (Waterhouse 2004). A plethora of technology enhanced learning systems has been already developed and many others are under the development practically all over the world. At the same time, one is unable to deny that even intelligent tutoring systems (ITS) are still behind the desired level of teaching and learning quality. Even the most advanced ITSs provide intelligent support of education process that is far behind of that provided by a human teacher who is able to adapt to each learner individually, to give a flexible feedback such as help, explanation, motivation, generation of individual tasks with different degrees of difficulty, and an assessment. Among all facets of needed feedback, a knowledge assessment plays the central role. It is very important that both players (a teacher and a learner) can keep track of learner's progress. Unfortunately, even in traditional teaching where regular knowledge assessment may be carried out in natural way, due to the high workload of university teachers, in practice they usually apply only final examinations. In e-learning regular knowledge assessment, as a rule, is carried out using tests which allow to assess learners' knowledge only at the first four levels of the well known Bloom's taxonomy which includes three levels of lower order skills: knowledge, comprehension, and application, and three levels of higher order skills: analysis, synthesis, and evaluation (Bloom 1956). The paper presents the approach in which a systematic knowledge assessment is carried out using the developed adaptive knowledge assessment system based on concept maps. The approach supports both kinds of knowledge assessment, namely, assessment given by a teacher, and self-assessment of learners. Knowledge self-assessment opportunities allow a learner to keep track of his/her progress, and to give a teacher feasibility to inform a learner about expected progress and to adjust a learning process making it more individualized.
[1]
Joseph D. Novak,et al.
Learning How to Learn
,
1984
.
[2]
Daniel L. Sherrell,et al.
Communications of the Association for Information Systems
,
1999
.
[3]
Shirley Waterhouse.
The Power of eLearning: The Essential Guide for Teaching in the Digital Age
,
2004
.
[4]
Alla Anohina-Naumeca,et al.
Changing the Degree of Task Difficulty in Concept Map Based Assessment System
,
2007
.
[5]
Vera Gouveia,et al.
Concept maps and the didactic role of assessment
,
2004
.
[6]
M. Araceli Ruiz-Primo,et al.
Examining Concept Maps as an Assessment Tool
,
2004
.
[7]
Claudia Leacock,et al.
Automated evaluation of essays and short answers
,
2001
.
[8]
K. Fisher.
Semantic Networking: The New Kid on the Block
,
1990
.
[9]
Russell G. Almond,et al.
Graphical Models and Computerized Adaptive Testing
,
1999
.
[10]
Nora Mogey,et al.
10: The use of computers in the assessment of student learning
,
1998
.
[11]
Kyparisia A. Papanikolaou,et al.
Compass: An Adaptive Web-Based Concept Map Assessment Tool
,
2004
.
[12]
Stephen Pulman,et al.
Automarking: using computational linguistics to score short‚ free−text responses
,
2003
.
[13]
Francisco Edson Lopes da Rocha,et al.
A new approach to meaningful learning assessment using concept maps: ontologies and genetic algorithms
,
2004
.
[14]
Yao-Ting Sung,et al.
Learning through computer-based concept mapping with scaffolding aid
,
2001,
J. Comput. Assist. Learn..
[15]
Wita Wojtkowski,et al.
Advances in Information Systems Development: New Methods and Practice for the Networked Society
,
2007
.
[16]
B. Bloom,et al.
Taxonomy of Educational Objectives. Handbook I: Cognitive Domain
,
1966
.
[17]
Kathleen M. Fisher,et al.
Computer-Based Concept Mapping
,
1990
.
[18]
Shyan-Ming Yuan,et al.
Students' use of web-based concept map testing and strategies for learning
,
2001,
J. Comput. Assist. Learn..
[19]
B. Bloom.
Taxonomy of educational objectives
,
1956
.
[20]
Lee A. Freeman,et al.
Concept Maps for Teaching and Assessment
,
2003,
Commun. Assoc. Inf. Syst..
[21]
M. Åhlberg.
Varieties of concept mapping
,
2004
.
[22]
Janis Grundspenkis,et al.
Using Concept Maps in Adaptive Knowledge Assessment
,
2007
.
[23]
Martin Chodorow,et al.
C-rater: Automated Scoring of Short-Answer Questions
,
2003,
Comput. Humanit..
[24]
Vita Šakele.
OWL Ontology Transformation into Concept Map
,
2008
.
[25]
Elena C. Papanastasiou,et al.
COMPUTER-ADAPTIVE TESTING IN SCIENCE EDUCATION
,
2003
.
[26]
Nouhad J. Rizk.
Computer-adaptive testing in science education
,
2003
.
[27]
Alla Anohina-Naumeca,et al.
A Concept Map Based Intelligent System for Adaptive Knowledge Assessment
,
2006,
DB&IS.
[28]
J. Grundspenkis,et al.
Prototype of multiagent knowledge assessment system for support of process oriented learning
,
2006,
2006 7th International Baltic Conference on Databases and Information Systems.