Conceptual Understanding of Newtonian Mechanics Through Cluster Analysis of FCI Student Answers

The Force Concept Inventory is a multiple-choice test and is one of the most popular and most analyzed concept inventories. It is used to investigate student understanding of Newtonian mechanics. A structured approach to data analysis can transform it in a “diagnostic” instrument that can validate inferences about student thinking. In this paper, we show how cluster analysis methods can be used to investigate patterns of student conceptual understanding and supply useful details about the relationships among student concepts and misconceptions. The answers given to the FCI questionnaire by a sample of freshman engineering have been analyzed. The analysis takes into account the decomposition of the force concept into the conceptual dimensions suggested by the FCI authors and successive studies. Our approach identifies latent structures within the student response patterns and groups students characterized by similar correct answers, as well as by non-correct answers. These response patterns give us new insights into the relationships between the student force concepts and their ability to analyze motions. Our results show that cluster analysis proved to be a useful tool to identify latent structures within the student conceptual understanding. Such structures can supply diagnostic insights for classroom pedagogy and teaching approaches.

[1]  Pankaj Saxena,et al.  Evolving Efficient Clustering Patterns in Liver Patient Data through Data Mining Techniques , 2013 .

[2]  Benedetto Di Paola,et al.  Investigating the quality of mental models deployed by undergraduate engineering students in creating explanations: The case of thermally activated phenomena , 2013 .

[3]  Douglas Huffman,et al.  What does the force concept inventory actually measure , 1995 .

[4]  Eugenia Etkina,et al.  ``Force,'' ontology, and language , 2009 .

[5]  Stephen D. Baker,et al.  An item response curves analysis of the Force Concept Inventory , 2012 .

[6]  R. Mantegna.  Hierarchical structure in financial markets , 1998, cond-mat/9802256.

[7]  Lei Bao,et al.  Model analysis of fine structures of student models: An example with Newton’s third law , 2002 .

[8]  David Hestenes,et al.  Interpreting the force concept inventory: A response to March 1995 critique by Huffman and Heller , 1995 .

[9]  P. Rousseeuw.  Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[10]  T. Caliński,et al.  A dendrite method for cluster analysis , 1974 .

[11]  B. Everitt,et al.  Cluster Analysis: Everitt/Cluster Analysis , 2011 .

[12]  Using Cluster Analysis to Identify Patterns in Students' Responses to Contextually Different Conceptual Problems. , 2012 .

[13]  R. Hake.  Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses , 1998 .

[14]  Andrew R. Gray,et al.  Exploratory factor analysis of a Force Concept Inventory data set , 2012 .

[15]  A. Savinainen,et al.  The Force Concept Inventory as a Measure of Students Conceptual Coherence , 2008 .

[16]  Gavin W. Fulmer.  VALIDATING PROPOSED LEARNING PROGRESSIONS ON FORCE AND MOTION USING THE FORCE CONCEPT INVENTORY: FINDINGS FROM SINGAPORE SECONDARY SCHOOLS , 2015 .

[17]  Ana Susac,et al.  Rasch Model Based Analysis of the Force Concept Inventory. , 2010 .

[18]  Terry F. Scott,et al.  Conceptual coherence of non-Newtonian worldviews in Force Concept Inventory data , 2017 .

[19]  Mia Hubert,et al.  Clustering in an object-oriented environment , 1997 .

[20]  Lei Bao,et al.  Analyzing force concept inventory with item response theory , 2010 .

[21]  Lei Bao,et al.  Model Analysis: Representing and Assessing the Dynamics of Student Learning. , 2006 .

[22]  Robert J. Beichner,et al.  Approaches to Data Analysis of Multiple-Choice Questions. , 2009 .

[23]  A. Savinainen,et al.  GENDER DIFFERENCES IN LEARNING OF THE CONCEPT OF FORCE, REPRESENTATIONAL CONSISTENCY, AND SCIENTIFIC REASONING , 2013 .

[24]  Jesper Bruun,et al.  Using module analysis for multiple choice responses: A new method applied to Force Concept Inventory data , 2016 .

[25]  Steven M. Goodreau,et al.  Understanding Classrooms through Social Network Analysis: A Primer for Social Network Analysis in Education Research , 2014, CBE life sciences education.

[26]  B. Efron,et al.  Bootstrap confidence intervals , 1996 .

[27]  J. Gower.  Some distance properties of latent root and vector methods used in multivariate analysis , 1966 .

[28]  P. Groenen,et al.  Modern multidimensional scaling , 1996 .

[29]  Brian Everitt,et al.  Cluster analysis , 1974 .

[30]  C. Fazio,et al.  Non-Hierarchical Clustering as a method to analyse an open-ended questionnaire on algebraic thinking , 2016 .

[31]  Edward H. Madden,et al.  Concepts of Force. , 1959 .

[32]  Nathaniel Lasry,et al.  The puzzling reliability of the Force Concept Inventory , 2011 .

[33]  D. Hestenes,et al.  Force concept inventory , 1992 .

[34]  R. Padraic Springuel,et al.  Applying Clustering to Statistical Analysis of Student Reasoning about Two-Dimensional Kinematics. , 2007 .

[35]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[36]  Paul S. Steif,et al.  New Practices for Administering and Analyzing the Results of Concept Inventories , 2007 .

[37]  John K. Gilbert,et al.  Learning Science Through Models and Modelling , 1998 .