A machine learning approach to investigating the effects of mathematics dispositions on mathematical literacy

ABSTRACT Mathematics competency is fast becoming an essential requirement in ever greater parts of day-to-day work and life. Thus, creating strategies for improving mathematics learning in students is a major goal of education research. However, doing so requires an ability to look at many aspects of mathematics learning, such as demographics and psychological dispositions, in an integrated way as part of the same system. Large-scale assessments such as the Programme for International Student Assessment (PISA) provide an accessible and large volume of coherent data, and this gives researchers the opportunity to employ data-driven approaches to gain an overview of the system. For these reasons, we have used machine learning to explore the relationships between psychological dispositions and mathematical literacy in Australian 15-year-olds using the PISA 2012 data set. Our results from this strongly data-driven approach re-affirm the primacy of mathematics self-efficacy and highlight novel complex interactions between mathematics self-efficacy, mathematics anxiety and socio-economic status. In this paper, we demonstrate how education researchers can usefully employ data-driven modelling techniques to find complex non-linear relationships and novel interactions in a multidimensional data set.

[1]  A. Hasan,et al.  Organisation for Economic Co-operation and Development , 2007 .

[2]  Ann Dowker,et al.  Mathematics Anxiety: What Have We Learned in 60 Years? , 2016, Front. Psychol..

[3]  T. Goetz,et al.  Do Girls Really Experience More Anxiety in Mathematics? , 2013, Psychological science.

[4]  Wondimu Ahmed,et al.  Emotions, Self-Regulated Learning, and Achievement in Mathematics: A Growth Curve Analysis , 2013 .

[5]  Andrew McConney,et al.  Does the SES of the School Matter? An Examination of Socioeconomic Status and Student Achievement Using PISA 2003 , 2010, Teachers College Record: The Voice of Scholarship in Education.

[6]  Frédéric Guay,et al.  Examining Perceived Control Level and Instability as Predictors of First-Year College Students' Academic Achievement. , 2012 .

[7]  Sian L. Beilock,et al.  Math anxiety: who has it, why it develops, and how to guard against it , 2012, Trends in Cognitive Sciences.

[8]  Edward L. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation , 2000 .

[9]  Carol S. Dweck,et al.  Mindsets and Math/Science Achievement , 2008 .

[10]  Anne C. Frenzel,et al.  The Control-Value Theory of Achievement Emotions: An Integrative Approach to Emotions in Education , 2007 .

[11]  Lazar Stankov,et al.  Confidence: the best non-cognitive predictor of academic achievement? , 2014 .

[12]  C. Abraham,et al.  Psychological correlates of university students' academic performance: a systematic review and meta-analysis. , 2012, Psychological bulletin.

[13]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[14]  D. Szűcs,et al.  Gender differences in mathematics anxiety and the relation to mathematics performance while controlling for test anxiety , 2012, Behavioral and Brain Functions.

[15]  R. Pekrun,et al.  Predicting long-term growth in students' mathematics achievement: the unique contributions of motivation and cognitive strategies. , 2013, Child development.

[16]  E. Murphy,et al.  Aboriginal and Torres Strait Islander peoples , 2015 .

[17]  C. Sansone,et al.  Intrinsic and extrinsic motivation : the search for optimal motivation and performance , 2000 .

[18]  Jürgen Baumert,et al.  Learners for Life. Student Approaches to Learning. Results from PISA 2000. , 2003 .

[19]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[20]  Sue Thomson,et al.  PISA 2012: how Australia measures up , 2013 .

[21]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Sian L. Beilock,et al.  Anxiety and cognition. , 2014, Wiley interdisciplinary reviews. Cognitive science.

[23]  Martin Valcke,et al.  Academic self-efficacy and academic self-concept: Reconsidering structural relationships , 2009 .

[24]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[25]  Bernd Bischl,et al.  mlr: Machine Learning in R , 2016, J. Mach. Learn. Res..

[26]  Leo Breiman,et al.  Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author) , 2001 .

[27]  F. Guay,et al.  Intrinsic Motivation and Achievement in Mathematics in Elementary School: A Longitudinal Investigation of Their Association. , 2016, Child development.

[28]  R. Pekrun.  The Control-Value Theory of Achievement Emotions: Assumptions, Corollaries, and Implications for Educational Research and Practice , 2006 .

[29]  Andrew McConney,et al.  Socioeconomic status, self-efficacy, and mathematics achievement in Australia: a secondary analysis , 2010 .

[30]  J Elith,et al.  A working guide to boosted regression trees. , 2008, The Journal of animal ecology.

[31]  J. Herman,et al.  OECD Reviews of Evaluation and Assessment in Education: Australia. , 2011 .

[32]  Marcia Linn,et al.  Psychology's role in mathematics and science education. , 2009, The American psychologist.

[33]  K. Aunola,et al.  Cross-lagged relations between task motivation and performance in arithmetic and literacy in kindergarten , 2009 .

[34]  Ashley B. Barr.  Family socioeconomic status, family health, and changes in students' math achievement across high school: A mediational model. , 2015, Social science & medicine.

[35]  Sue Thomson,et al.  Highlights from TIMSS & PIRLS 2011 from Australia’s perspective , 2012 .

[36]  S. Thomson.  Session I - Gender and Mathematics: Quality and equity , 2014 .

[37]  Lisa De Bortoli,et al.  A Teacher's Guide to PISA Mathematical Literacy , 2013 .

[38]  J. Friedman.  Greedy function approximation: A gradient boosting machine. , 2001 .

[39]  Robert Plomin,et al.  Predicting school achievement from general cognitive ability, self-perceived ability, and intrinsic value. , 2006 .

[40]  Daniel P Keating,et al.  Gendered motivational processes affecting high school mathematics participation, educational aspirations, and career plans: a comparison of samples from Australia, Canada, and the United States. , 2012, Developmental psychology.

[41]  Wolfram Schulz.  Mathematics Self-Efficacy and Student Expectations. Results from PISA 2003. , 2005 .

[42]  Dennis M. Wilkinson,et al.  Large-Scale Parallel Collaborative Filtering for the Netflix Prize , 2008, AAIM.

[43]  A. E. Gottfried,et al.  Academic Intrinsic Motivation in Elementary and Junior High School Students. , 1985 .

[44]  Andrew Slater,et al.  The Learning Behind Gmail Priority Inbox , 2010 .

[45]  M. Linn,et al.  New trends in gender and mathematics performance: a meta-analysis. , 2010, Psychological bulletin.

[46]  A. Yeung,et al.  Self-concepts and educational outcomes of Indigenous Australian students in urban and rural school settings , 2013 .

[47]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[48]  G. Marks,et al.  Tertiary entrance performance : the role of student background and school factors. , 2001 .

[49]  Examining the evidence: Science achievement in Australian schools in TIMSS 2002 , 2004 .

[50]  J. Baumert,et al.  Learners for life : student approaches to learning , 2003 .

[51]  Janet Shibley Hyde,et al.  Cross-national patterns of gender differences in mathematics: a meta-analysis. , 2010, Psychological bulletin.

[52]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[53]  A. Bandura.  Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[54]  Selcuk R. Sirin.  Socioeconomic Status and Academic Achievement: A Meta-Analytic Review of Research , 2005 .

[55]  M. Ehren,et al.  OECD reviews of evaluation and assessment in education: Luxembourg 2012 , 2012 .