A Statistical Study of Concept Mapping Metrics

This paper reports on our exploratory statistical study of the relationships among a selection of traditional and holistic concept mapping metrics. Specifically, twelve traditional metrics (nine from the literature and three of our own design) and four holistic metrics (all from the literature) were used to evaluate the concept maps of two sets of engineering students: (i) 73 undergraduate engineers enrolled in first-year engineering design; and (ii) 52 graduate engineers enrolled in a master’s level systems engineering course. Our results showed 41 common correlated pairs between these two samples, all at the p<0.05 level of significance. The implications of these correlations for engineering educators are discussed, along with potential directions for future research to expand this area of study.

[1]  Ian M. Kinchin,et al.  Using concept mapping to measure learning quality , 2008 .

[2]  I. Kinchin,et al.  Using concept maps to reveal conceptual typologies , 2006 .

[3]  H. Suen,et al.  Concept Map Assessment of Classroom Learning: Reliability, Validity, and Logistical Practicality , 1999 .

[4]  Paul H. King,et al.  Concept Mapping as a Form of Student Assessment and Instruction , 2002 .

[5]  J. Kerski.  Mapping for Understanding Our Changing World , 2006 .

[6]  R. Shavelson,et al.  On the Validity of Cognitive Interpretations of Scores From Alternative Concept-Mapping Techniques , 2001 .

[7]  R.S. Parker,et al.  Work In Progress: Pillars of Chemical Engineering , 2005, Proceedings Frontiers in Education 35th Annual Conference.

[8]  I. Kinchin,et al.  Quantitative and qualitative measures of student learning at university level , 2008 .

[9]  Joseph D. Novak,et al.  Learning How to Learn , 1984 .

[10]  I. Kinchin,et al.  How a qualitative approach to concept map analysis can be used to aid learning by illustrating patterns of conceptual development , 2000 .

[11]  Maria Pampaka,et al.  Assessing Students' Learning in MIS using Concept Mapping , 2009, J. Inf. Syst. Educ..

[12]  Mary Besterfield-Sacre,et al.  Scoring Concept Maps: An Integrated Rubric for Assessing Engineering Education , 2004 .

[13]  M. Graff.  Differences in concept mapping, hypertext architecture, and the analyst–intuition dimension of cognitive style , 2005 .

[14]  Cynthia J. Atman,et al.  Concept maps for engineering education: a cognitively motivated tool supporting varied assessment functions , 2000, IEEE Trans. Educ..

[15]  Colin J. Neill,et al.  A cognitive collaborative model to improve performance in engineering teams—A study of team outcomes and mental model sharing , 2011, Syst. Eng..

[16]  R. Shavelson,et al.  Problems and Issues in the Use of Concept Maps in Science Assessment. , 1996 .

[17]  Peter A. Rubba,et al.  Scoring Concept Maps: An Expert Map-Based Scheme Weighted for Relationships , 2002 .

[18]  Dirk Ifenthaler,et al.  The mystery of cognitive structure and how we can detect it: tracking the development of cognitive structures over time , 2011 .