Highly integrated model assessment technology and tools

Effective and efficient measurement of the development of skill and knowledge, especially in domains of human activity that involve complex and challenging problems, is important with regard to workplace and academic performance. However, there has been little progress in the area of practical measurement and assessment, due in part to the lack of automated tools that are appropriate for assessing the acquisition and development of complex cognitive skills. In the last 2 years, an international team of researchers has developed and validated an integrated set of assessment tools called highly integrated model assessment technology and tools (HIMATT) which addresses this deficiency. HIMATT is web-based and has been shown to scale up for practical use in educational and workplace settings, unlike many of the research tools developed solely to study basic issues in human learning and performance. In this paper, we describe the functions of HIMATT and demonstrate several applications for its use. Additionally, we present two studies on the quality and usability of HIMATT. We conclude with research suggestions for the use of HIMATT and for its further development.

[1]  Lyn Frazier,et al.  On Sentence Interpretation , 1999 .

[2]  C. Harris.  Problems in measuring change , 1965 .

[3]  W. T. Tutte.  Graph Theory , 1984 .

[4]  Ernest Davis,et al.  Representations of commonsense knowledge , 2014, notThenot Morgan Kaufmann series in representation and reasoning.

[5]  Dirk Ifenthaler,et al.  Planning and Assessing Navigation in Model-Centered Learning Environments. Why Learners Often Do Not Follow the Path Laid Out for Them , 2005 .

[6]  Béla Bollobás,et al.  Modern Graph Theory , 2002, Graduate Texts in Mathematics.

[7]  Dirk Ifenthaler,et al.  Diagnose lernabhängiger Veränderung mentaler Modelle : Entwicklung der SMD-Technologie als methodologisches Verfahren zur relationalen, strukturellen und semantischen Analyse individueller Modellkonstruktionen , 2006 .

[8]  Howard R. Pollio.  The Structural Basis of Word Association Behavior , 1966 .

[9]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[10]  T. McNamara.  Priming and theories of memory : a reply to Ratcliff and McKoon , 1994 .

[11]  J. Michael Spector,et al.  A methodology for assessing learning in complex and ill‐structured task domains , 2006 .

[12]  Dirk Ifenthaler,et al.  The measurement of change : learning-dependent progression of mental models , 2005 .

[13]  J. Kruskal.  Nonmetric multidimensional scaling: A numerical method , 1964 .

[14]  Roger W. Schvaneveldt,et al.  Pathfinder associative networks: studies in knowledge organization , 1990 .

[15]  R Ratcliff,et al.  Retrieving information from memory: spreading-activation theories versus compound-cue theories. , 1994, Psychological review.

[16]  Roger Ratcliff,et al.  Inference during reading. , 1992 .

[17]  Ray Jackendoff.  Semantics and Cognition , 1983 .

[18]  Linda M. Collins,et al.  New methods for the analysis of change , 2001 .

[19]  Dirk Ifenthaler,et al.  Relational, structural, and semantic analysis of graphical representations and concept maps , 2010 .

[20]  P. Rothmaler.  Introduction to Model Theory , 2000 .

[21]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[22]  James J. Jenkins,et al.  STUDIES ON THE ROLE OF LANGUAGE IN BEHAVIOR - THE COMPLETE MINNESOTA NORMS FOR RESPONSES TO 100 WORDS FROM THE KENT-ROSANOFF WORD ASSOCIATION TEST , 1954 .

[23]  Dirk Ifenthaler.  Diagnose lernabhängiger veränderung mentaler modelle , 2006 .

[24]  J. Michael Spector,et al.  Comparative study of mental model research methods : relationships among ACSMM, SMD, MITOCAR & deep methodologies , 2006 .

[25]  Dirk Ifenthaler,et al.  Reading with the guide of automated graphical representations : how model based text visualizations facilitate learning in reading comprehension tasks , 2008 .

[26]  T. McNamara.  Priming and constraints it places on theories of memory and retrieval , 1992 .

[27]  Ying Ding,et al.  A review of ontologies with the Semantic Web in view , 2001, J. Inf. Sci..

[28]  Dirk Ifenthaler,et al.  The Role of Cognitive Learning Strategies and Intellectual Abilities in Mental Model Building Processes , 2007 .

[29]  P. Johnson-Laird.  Mental models , 1989 .

[30]  A. Tversky.  Features of Similarity , 1977 .

[31]  Dirk Ifenthaler,et al.  Understanding models for learning and instruction , 2008 .

[32]  H. Simon,et al.  How to Study Thinking in Everyday Life: Contrasting Think-Aloud Protocols With Descriptions and Explanations of Thinking , 1998 .

[33]  Emden R. Gansner,et al.  Graphviz and Dynagraph – Static and Dynamic Graph Drawing Tools , 2003 .

[34]  Dirk Ifenthaler,et al.  Practical Solutions for the Diagnosis of Progressing Mental Models , 2008 .

[35]  K. Lewin,et al.  Das Problem der Willensmessung und das Grundgesetz der Assoziation. I , 1922 .