Reporting and Interpreting Quantitative Research Findings: What Gets Reported and Recommendations for the Field.

This paper presents a set of guidelines for reporting on five types of quantitative data issues: (1) Descriptive statistics, (2) Effect sizes and confidence intervals, (3) Instrument reliability, (4) Visual displays of data, and (5) Raw data. Our recommendations are derived mainly from various professional sources related to L2 research but motivated by results from investigations into how well the field as a whole is following these guidelines for best methodological practices, and illustrated by L2 examples. Although recent surveys of L2 reporting practices have found that more researchers are including important data such as effect sizes, confidence intervals, reliability coefficients, research questions, a priori alpha levels, graphics, and so forth in their research reports, we call for further improvement so that research findings may build upon each other and lend themselves to meta-analyses and a mindset that sees each research project in the context of a coherent whole.

[1]  Lee B. Abraham Computer-mediated glosses in second language reading comprehension and vocabulary learning: A meta-analysis , 2008 .

[2]  Jenifer Larson-Hall,et al.  Improving Data Analysis in Second Language Acquisition by Utilizing Modern Developments in Applied Statistics , 2010 .

[3]  Shaofeng Li The Effectiveness of Corrective Feedback in SLA: A Meta-Analysis. , 2010 .

[4]  Grant Henning,et al.  Quantitative Methods in Language Acquisition Research , 1986 .

[5]  R. Lyster DIFFERENTIAL EFFECTS OF PROMPTS AND RECASTS IN FORM-FOCUSED INSTRUCTION , 2004, Studies in Second Language Acquisition.

[6]  Carol A. Chapelle,et al.  A meta-analysis of effectiveness studies on computer technology-supported language learning , 2013, ReCALL.

[7]  C. Sansone,et al.  Improving the Dependability of Research in Personality and Social Psychology , 2014, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[8]  J. Norris,et al.  Effectiveness of L2 Instruction: A Research Synthesis and Quantitative Meta‐analysis , 2000 .

[9]  Charlene Rivera,et al.  Mean Effects of Test Accommodations for ELLs and Non‐ELLs: A Meta‐Analysis of Experimental Studies , 2011 .

[10]  S. Gass,et al.  Quantitative Research Methods, Study Quality, and Outcomes: The Case of Interaction Research , 2011 .

[11]  Tadayoshi Kaya,et al.  5. Effects of L2 instruction on interlanguage pragmatic development: A meta-analysis , 2006 .

[12]  Luke D Plonsky,et al.  Study quality in quantitative l2 research (1990-2010): A methodological synthesis and call for reform , 2014 .

[13]  Tracy A. Lavin,et al.  Pedagogical strategies for teaching literacy to ESL immigrant students: a meta-analysis. , 2011, The British journal of educational psychology.

[14]  Hsien-Chin Liou,et al.  THE EFFECTS OF TEXT-BASED SCMC ON SLA: A META ANALYSIS , 2013 .

[15]  W. Tierney,et al.  Hate Speech and Academic Freedom in the Academy , 2006 .

[16]  R. Ellis Introduction: Investigating Form‐Focused Instruction , 2001 .

[17]  Susan M. Gass,et al.  The use of statistics in L2 acquisition research , 2009, Language Teaching.

[18]  Tracy A. Lavin,et al.  A Systematic Review and Meta-Analysis of the Cognitive Correlates of Bilingualism , 2010 .

[19]  Luke D Plonsky,et al.  An Assessment of Designs, Analyses, and Reporting Practices in Quantitative L2 Research , 2013 .

[20]  Thomas H. Dinsmore 2. Principles, parameters, and SLA: A retrospective meta-analytic investigation into adult L2 learners’ access to Universal Grammar , 2006 .

[21]  Luke Plonsky,et al.  How Big Is “Big”? Interpreting Effect Sizes in L2 Research , 2014 .

[22]  Apa Publications,et al.  Reporting standards for research in psychology: why do we need them? What might they be? , 2008, The American psychologist.

[23]  Sang-Ki Lee,et al.  VISUAL INPUT ENHANCEMENT AND GRAMMAR LEARNING: A Meta-Analytic Review , 2008, Studies in Second Language Acquisition.

[24]  Jenifer Larson-Hall Weighing the benefits of studying a foreign language at a younger starting age in a minimal input situation , 2008 .

[25]  Craig Chaudron Progress in Language Classroom Research: Evidence from The Modern Language Journal, 1916‐2000 , 2001 .

[26]  R. Dekeyser,et al.  BEYOND EXPLICIT RULE LEARNING , 1997, Studies in Second Language Acquisition.

[27]  Florence Debarre,et al.  The Availability of Research Data Declines Rapidly with Article Age , 2013, Current Biology.

[28]  D. Nunan Methods in Second Language Classroom-Oriented Research , 1991, Studies in Second Language Acquisition.

[29]  Graham Crookes Another Researcher Comments , 1991 .

[30]  J. Norris Statistical Significance Testing in Second Language Research: Basic Problems and Suggestions for Reform , 2015 .

[31]  David J. Francis,et al.  Accommodations for English Language Learners Taking Large-Scale Assessments: A Meta-Analysis on Effectiveness and Validity , 2009 .

[32]  Lourdes Ortega,et al.  Synthesizing research on language learning and teaching , 2006 .

[33]  Luke Plonsky,et al.  SYSTEMATIC REVIEW ARTICLE The Effectiveness of Second Language Strategy Instruction: A Meta-analysis , 2011 .

[34]  Heidi Byrnes,et al.  Notes from the editor: Notes from the Editor , 2014 .