Using Data Mining to Predict K-12 Students' Performance on Large-Scale Assessment Items Related to Energy.

This article reports a study on using data mining to predict K-12 students' competence levels on test items related to energy. Data sources are the 1995 Third International Mathematics and Science Study (TIMSS), 1999 TIMSS-Repeat, 2003 Trend in International Mathematics and Science Study (TIMSS), and the National Assessment of Educational Progress (NAEP). Student population performances, that is, percentages correct, are the object of prediction. Two data mining algorithms, C4.5 and M5, are used to construct a decision tree and a linear function to predict students' performance levels. A combination of factors related to content, context, and cognitive demand of items and to students' grade levels are found to predict student population performances on test items. Cognitive demands have the most significant contribution to the prediction. The decision tree and linear function agree with each other on predictions. We end the article by discussing implications of findings for future science content standard development

[1]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[2]  R. Trumper.  A survey of conceptions of energy of Israeli pre‐service high school biology teachers , 1997 .

[3]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[4]  D. M. Watts,et al.  Some alternative views of energy , 1983 .

[5]  J. Shea.  National Science Education Standards , 1995 .

[6]  D. Ayres.  The Magnetic Attraction of Honeybee Navigation. , 1991 .

[7]  Albert Pilot,et al.  The Use of “Contexts” as a Challenge for the Chemistry Curriculum: Its successes and the need for further development and understanding , 2006 .

[8]  R. Driver,et al.  Making sense of secondary science , 1994 .

[9]  Anne McKeough,et al.  Developmental growth in students' concept of energy: Analysis of selected items from the TIMSS database , 2005 .

[10]  L. S. Vygotksy.  Mind in society: the development of higher psychological processes , 1978 .

[11]  Gregory P. Thomas,et al.  Rationale and Approaches for Embedding Scientific Literacy into the New Junior Secondary School Chemistry Curriculum in the People’s Republic of China , 2005 .

[12]  Jo Ellen Roseman,et al.  How well do middle school science programs measure up? Findings from Project 2061's curriculum review , 2002 .

[13]  N. Heath.  Heating and working man's club , 1983 .

[14]  Ellin Kofsky Scholnick,et al.  Conceptual Development : Piaget's Legacy , 1999 .

[15]  R. Suganya,et al.  Data Mining Concepts and Techniques , 2010 .

[16]  Kathleen E. Metz.  Reassessment of Developmental Constraints on Children’s Science Instruction , 1995 .

[17]  R. Driver,et al.  Pupils and Paradigms: a Review of Literature Related to Concept Development in Adolescent Science Students , 1978 .

[18]  Michelene T. H. Chi,et al.  Expertise in Problem Solving. , 1981 .

[19]  Xiufeng Liu,et al.  Structural characteristics of university engineering students' conceptions of energy* , 2002 .

[20]  K. H. Stauder.  [Psychology of the child]. , 1953, Medizinische Klinik.

[21]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[22]  Francis P. Hunkins,et al.  Curriculum: Foundations, Principles, and Issues , 1988 .

[23]  Rodger W. Bybee,et al.  The Teaching of Science: Content, Coherence, and Congruence , 2003 .

[24]  Meryl W. Bertenthal,et al.  Systems for state science assessment , 2005 .

[25]  John K. Gilbert,et al.  Enigmas in School Science: students’ conceptions for scientifically associated words , 1983 .

[26]  Joan Solomon.  Messy, Contradictory and Obstinately Persistent: A Study of Children's Out-of-School Ideas about Energy. , 1983 .

[27]  Edgar W. Jenkins,et al.  Benchmarks for Science Literacy: a review symposium∗ , 1995 .

[28]  S. Carey.  Conceptual Change in Childhood , 1985 .

[29]  J. Gilbert.  On the Nature of “Context” in Chemical Education , 2006 .

[30]  E. Wenger,et al.  Legitimate Peripheral Participation , 1991 .

[31]  S. Engel.  Thought and Language , 1964 .

[32]  Luli Stern.  Reply: Analysis of students' assessments in curriculum materials: Fidelity to national standards , 2003 .

[33]  Dana L. Kelly,et al.  International Association for the Evaluation of Educational Achievement , 1998 .

[34]  J. Mintzes,et al.  Reform and Innovation in Science Teaching: A Human Constructivist View , 2005 .

[35]  L. Tang,et al.  The Progression of Students’ Conceptions of Energy: A Cross-Grade, Cross-Cultural Study , 2004 .

[36]  G. Wiggins,et al.  Understanding by Design , 1998 .

[37]  W. Schmidt,et al.  Curriculum coherence: an examination of US mathematics and science content standards from an international perspective , 2005 .

[38]  D. Laplane.  Thought and language. , 1992, Behavioural neurology.

[39]  J. R. Quinlan.  Learning With Continuous Classes , 1992 .

[40]  Luli Stern,et al.  Analysis of students' assessments in middle school curriculum materials: Aiming precisely at benchmarks and standards , 2002 .

[41]  Richard E. Mayer,et al.  The Psychology of Abilities, Competencies, and Expertise: What Causes Individual Differences in Cognitive Performance? , 2003 .

[42]  J. Mintzes,et al.  Teaching Science for Understanding: A Human Constructivist View , 1998 .

[43]  Joan Solomon,et al.  Learning about energy: how pupils think in two domains , 1983 .

[44]  Gergory J. Cizek,et al.  Standard Setting: A Guide to Establishing and Evaluating Performance Standards on Tests , 2006 .

[45]  Comment: Aiming precisely at standards that are not there: Kinetic molecular theory, scientific theories, and national standards , 2003 .

[46]  Theo L. Dawson-Tunik.  Stage-Like Patterns in the Development of Conceptions of Energy , 2006 .

[47]  Mike Summers,et al.  Surveys of english primary teachers' conceptions of force, energy, and materials , 1992 .

[48]  A. Collins.  National Science Education Standards: A Political Document. , 1998 .

[49]  R. Sternberg,et al.  The Psychology of Intelligence , 2002 .

[50]  D. Ravitch.  National Standards in American Education: A Citizen's Guide , 1995 .

[51]  M. Stanisstreet,et al.  Misunderstanding of 'Law' and 'Conservation': a study of pupils' meaning for these terms. , 1990 .

[52]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[53]  Hongyan Liu,et al.  Top-Down Mining of Interesting Patterns from Very High Dimensional Data , 2006, 22nd International Conference on Data Engineering (ICDE'06).