Kit-Build Concept Map with Confidence Tagging in Practical Uses for Assessing the Understanding of Learners

An answer of a learner can be interpreted as a learning evidence for demonstrating the understanding of the learner, while a confidence on the answer represents the belief of the learner as the degree of understanding. In this paper, we propose Kit-Build concept map with confidence tagging. Kit-Build concept map (KB map in short) is a digital tool for supporting a concept map strategy where learners can create the learning evidence, and the instructor can access the correctness and confidence information of learners. The practical uses were conducted for demonstrating the valuable of correctness and confidence information in the lecture class. The correctness information was visualized in the control classes, while the correctness and confidence information were visualized in the experiment classes. The observed evidence illustrates that the different information was used for selecting and ordering the supplementary content when the system visualized the different information. The normalized learning gains and effect size demonstrate the different learning achievements between control- and experiment- classes. The results suggest that the confidence information of learner affects the instructor behaviors, which is the positive changing behavior for improving the understanding of their learners. The results of questionnaire suggest that the KB map with confidence tagging is an accepted mechanism for representing the learner’s understanding and their confidence. The instructors also accepted that the confidence information of learners is valuable information for recognizing the learning situation.

[1]  Yusuke Hayashi,et al.  The practical use of Kit-Build concept map on formative assessment , 2017, Res. Pract. Technol. Enhanc. Learn..

[2]  Yusuke Hayashi,et al.  Automatic Concept Map Assessment in Formative Assessment Approach , 2016 .

[3]  Lazar Stankov,et al.  Confidence and cognitive test performance , 2008 .

[4]  Roy B. Clariana,et al.  A Technique for Automatically Scoring Open-Ended Concept Maps , 2006 .

[5]  P. Black,et al.  Teachers developing assessment for learning: impact on student achievement , 2004 .

[6]  A. Efklides Metacognition and Affect: What Can Metacognitive Experiences Tell Us about the Learning Process?. , 2006 .

[7]  Petar Cisar,et al.  True/false questions analysis using computerized Certainty-Based Marking tests , 2009, 2009 7th International Symposium on Intelligent Systems and Informatics.

[8]  A. Efklides,et al.  METACOGNITIVE EXPERIENCES, SELF-CONCEPT, AND SELF-REGULATION , 2002 .

[9]  R. Hake Interactive-engagement vs Traditional Methods in Mechanics Instruction* , 1998 .

[10]  J. Novak,et al.  The theory underlying concept maps , 2016 .

[11]  Taha Rajab,et al.  Comparison between Kit-Build and Scratch-Build Concept Mapping Methods in Supporting EFL Reading Comprehension , 2015 .

[12]  W. Marsden I and J , 2012 .

[13]  I-Lin Gloria Hsieh,et al.  Types of feedback in a computer-based collaborative problem-solving group task , 2002, Comput. Hum. Behav..

[14]  Aliisa Mylonas,et al.  Developing Procedures for Implementing Peer Assessment in Large Classes Using an Action Research Process , 2002 .

[15]  James E. Bruno,et al.  Using Testing to Provide Feedback to Support Instruction: A Reexamination of the Role of Assessment in Educational Organizations , 1993 .

[16]  A. Cañas,et al.  Concept Maps: Making Learning Meaningful Proc. of Fourth Int. Conference on Concept Mapping Formative Structural Assessment: Using Concept Maps as Assessment for Learning , 2022 .

[17]  Darwin P. Hunt,et al.  The concept of knowledge and how to measure it , 2003 .

[18]  Gregory K. W. K. Chung,et al.  Computer-based performance assessments: a solution to the narrow measurement and reporting of problem-solving , 1999 .

[19]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[20]  AR Gardner-Medwin,et al.  Certainty-Based Marking (CBM) for reflective learning and proper knowledge assessment , 2007 .

[21]  A. R. Gardner-Medwin,et al.  Formative and summative confidence- based assessment , 2003 .

[22]  Tsukasa Hirashima,et al.  Comparison of Kit-Build and Scratch-Build Concept Mapping Methods on Memory Retention , 2011 .

[23]  Carl Martin Allwood,et al.  Metacognitive Self-Confidence in School-Aged Children , 2012 .

[24]  Alberto J. Cañas,et al.  A TEORIA SUBJACENTE AOS MAPAS CONCEITUAIS E COMO ELABORÁ-LOS E USÁ-LOS * THE THEORY UNDERLYING CONCEPT MAPS AND HOW TO CONSTRUCT AND USE THEM , 2010 .

[25]  Sabina Kleitman,et al.  Self-Confidence and Academic Achievements in Primary-School Children: Their Relationships and Links to Parental Bonds, Intelligence, Age, and Gender , 2010 .

[26]  Chei-Chang Chiou,et al.  The effect of concept mapping on students’ learning achievements and interests , 2008 .

[27]  Insu Paek,et al.  Realism of Confidence Judgments , 2009 .

[28]  Andrew M. Parker,et al.  Individual differences in adult decision-making competence. , 2007, Journal of personality and social psychology.

[29]  Gavin Heron,et al.  Re-engineering the multiple choice question exam for social work , 2013 .

[30]  Ar Gardner-Medwin Optimisation of certainty-based assessment scores , 2013 .

[31]  Gigi Y. Yuen-Reed,et al.  Engineering Student Self-Assessment through Confidence-Based Scoring. , 2015 .

[32]  Yusuke Hayashi,et al.  Experimental Evaluation of the KB-mapping Method to Avoid Sentence-by-Sentence Map-building Style in EFL Reading with Concept Mapping , 2016 .

[33]  Tsukasa Hirashima,et al.  Framework of kit-build concept map for automatic diagnosis and its preliminary use , 2015, Res. Pract. Technol. Enhanc. Learn..

[34]  Mehmet Buldu,et al.  Concept mapping as a formative assessment in college classrooms: Measuring usefulness and student satisfaction , 2010 .

[35]  Pasana Chularut,et al.  The influence of concept mapping on achievement, self-regulation, and self-efficacy in students of English as a second language , 2004 .

[36]  Taha Rajab,et al.  Experimental Use of Kit-Build Concept Map System to Support Reading Comprehension of EFL in Comparing with Selective Underlining Strategy , 2016 .

[37]  Takuya Osada,et al.  Instantaneous Assessment of Learners' Comprehension for Lecture by Using Kit-Build Concept Map System , 2013, HCI.