Large‐scale science education intervention research we can use

This article develops an argument that the type of intervention research most useful for improving science teaching and learning and leading to scalable interventions includes both research to develop and gather evidence of the efficacy of innovations and a different kind of research, design-based implementation research (DBIR). DBIR in education focuses on what is required to bring interventions and knowledge about learning to all students, wherever they might engage in science learning. This research focuses on implementation, both in the development and initial testing of interventions and in the scaling up process. In contrast to traditional intervention research that focuses principally on one level of educational systems, DBIR designs and tests interventions that cross levels and settings of learning, with the aim of investigating and improving the effective implementation of interventions. The article concludes by outlining four areas of DBIR that may improve the likelihood that new standards for science education will achieve their intended purpose of establishing an effective, equitable, and coherent system of opportunities for science learning in the United States. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 281–304, 2012

[1]  N. Freemantle,et al.  Continuing education meetings and workshops: effects on professional practice and health care outcomes , 2001 .

[2]  Ann Rosebery,et al.  Rethinking diversity in learning science: The logic of everyday sense‐making , 2001 .

[3]  Jessica Thompson,et al.  How Novice Science Teachers Appropriate Epistemic Discourses Around Model-Based Inquiry for Use in Classrooms , 2008 .

[4]  Ann Lieberman Networks as Learning Communities , 2000 .

[5]  Wendy McColskey,et al.  Building Teacher Capacity in Classroom Assessment To Improve Student Learning , 2004 .

[6]  James M. Bieman,et al.  Rapid Prototyping: Lessons Learned , 1995, IEEE Softw..

[7]  Aaron Rogat,et al.  Learning Progressions in Science: An Evidence-Based Approach to Reform. CPRE Research Report # RR-63. , 2009 .

[8]  John Willinsky,et al.  The Strategic Education Research Program and the Public Value of Research , 2001 .

[9]  Joseph Krajcik,et al.  Learning at the nanoscale: research questions that the rapidly evolving interdisciplinarity of science poses for the learning sciences , 2006 .

[10]  T. Hatch,et al.  Crafting Coherence: How Schools Strategically Manage Multiple, External Demands , 2004 .

[11]  Kevin O'Connor,et al.  Learning as the Organizing of Social Futures , 2010, Teachers College Record: The Voice of Scholarship in Education.

[12]  Kris D. Gutiérrez,et al.  Cultural Ways of Learning: Individual Traits or Repertoires of Practice , 2003 .

[13]  James Paul Gee,et al.  Language in the Science Classroom: Academic Social Languages as the Heart of School-Based Literacy , 2004 .

[14]  Heidi B. Carlone,et al.  Assessing Equity Beyond Knowledge- and Skills-based Outcomes: A Comparative Ethnography of Two Fourth-grade Reform-based Science Classrooms , 2011 .

[15]  Joseph Krajcik,et al.  What Does It Mean To Create Sustainable Science Curriculum Innovations? A Commentary. , 2003 .

[16]  David S. Cordray,et al.  Treatment Strength and Integrity: Models and Methods. , 2006 .

[17]  Okhee Lee,et al.  Dilemmas in Scaling Up Innovations in Elementary Science Instruction With Nonmainstream Students , 2005 .

[18]  Comments on Slavin: Bringing Answers to Educators: Guiding Principles for Research Syntheses , 2008 .

[19]  Helen R. Quinn,et al.  A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas , 2013 .

[20]  William R. Penuel,et al.  Preparing Teachers to Design Instruction for Deep Understanding in Middle School Earth Science , 2009 .

[21]  Geoffrey D. Borman,et al.  A Randomized Trial of Teacher Development in Elementary Science: First-Year Achievement Effects , 2008 .

[22]  W. Penuel,et al.  Introduction: Principles of a Human Sciences Approach to Research on Learning , 2010, Teachers College Record: The Voice of Scholarship in Education.

[23]  R. Reich Aftershock: The Next Economy and America’s Future , 2010 .

[24]  Edgar W. Jenkins,et al.  Benchmarks for Science Literacy: a review symposium∗ , 1995 .

[25]  Sharon J. Lynch,et al.  Using Multilevel Analyses to Study the Effectiveness of Science Curriculum Materials , 2008 .

[26]  Katherine L. McNeill,et al.  Learning‐goals‐driven design model: Developing curriculum materials that align with national standards and incorporate project‐based pedagogy , 2008 .

[27]  Hee-Sun Lee,et al.  Technology-Rich Inquiry Science in Urban Classrooms: What are the Barriers to Inquiry Pedagogy? , 2002 .

[28]  Reed Stevens,et al.  Becoming an Engineer: Toward a Three Dimensional View of Engineering Learning , 2008 .

[29]  Douglas L. Medin,et al.  Cultural processes in science education: Supporting the navigation of multiple epistemologies , 2010 .

[30]  Jeannett Martin,et al.  Writing Science: Literacy And Discursive Power , 1993 .

[31]  Kevin O'Connor,et al.  Learning Research as a Human Science: Old Wine in New Bottles? , 2010, Teachers College Record: The Voice of Scholarship in Education.

[32]  Todd R. Stinebrickner,et al.  Race, Poverty, and Teacher Mobility , 2005 .

[33]  Laura M. Desimone,et al.  What Makes Professional Development Effective? Results From a National Sample of Teachers , 2001 .

[34]  E. Soloway,et al.  Creating Usable Innovations in Systemic Reform: Scaling Up Technology-Embedded Project-Based Science in Urban Schools , 2000 .

[35]  G. Wiggins,et al.  Understanding by Design , 1998 .

[36]  Miriam Gamoran Sherin,et al.  Practicing Change: Curriculum Adaptation and Teacher Narrative in the Context of Mathematics Education Reform , 2006 .

[37]  A. Collins National Science Education Standards: A Political Document. , 1998 .

[38]  Anthony S. Bryk,et al.  Support a Science of Performance Improvement , 2009 .

[39]  David R. Millen,et al.  Rapid ethnography: time deepening strategies for HCI field research , 2000, DIS '00.

[40]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[41]  Carol L. O'Donnell Defining, Conceptualizing, and Measuring Fidelity of Implementation and Its Relationship to Outcomes in K–12 Curriculum Intervention Research , 2008 .

[42]  Stephen B. Johnson,et al.  Central challenges facing the national clinical research enterprise. , 2003, JAMA.

[43]  Jo Ellen Roseman,et al.  How well do middle school science programs measure up? Findings from Project 2061's curriculum review , 2002 .

[44]  Philip M. Sadler,et al.  Connecting High School Physics Experiences, Outcome Expectations, Physics Identity, and Physics Career Choice: A Gender Study. , 2010 .

[45]  F. Sloane Comments on Slavin: Through the Looking Glass: Experiments, Quasi-Experiments, and the Medical Model , 2008 .

[46]  Sarah Michaels,et al.  Aligning Academic Task and Participation Status through Revoicing: Analysis of a Classroom Discourse Strategy , 1993 .

[47]  Kathryn A. LeRoy,et al.  Science achievement of English language learners in Urban elementary schools: Results of a first-year professional development intervention , 2008 .

[48]  J. Lemke Talking Science: Language, Learning, and Values , 1990 .

[49]  Iris Tabak Prospects for Change at the Nexus of Policy and Design , 2006 .

[50]  Josiane Hudicourt-Barnes,et al.  The Use of Argumentation in Haitian Creole Science Classrooms , 2003 .

[51]  Kris D. Gutiérrez,et al.  Rethinking diversity: Hybridity and hybrid language practices in the third space , 1999 .

[52]  Jere Confrey,et al.  Implementation Research as a Means to Link Systemic Reform and Applied Psychology in Mathematics Education , 2000 .

[53]  James P. Spillane,et al.  Urban school leadership for elementary science instruction: Identifying and activating resources in an undervalued school subject , 2001 .

[54]  B. Jacob,et al.  The Challenges of Staffing Urban Schools with Effective Teachers , 2007, The Future of children.

[55]  Kris D. Gutiérrez,et al.  Lifting Off the Ground to Return Anew: Mediated Praxis, Transformative Learning, and Social Design Experiments , 2010 .

[56]  Sharon J. Lynch,et al.  Scaling Up Highly Rated Middle Science Curriculum Units for Diverse Student Populations : Features That Affect Collaborative Research and Vice Versa 1 , 2007 .

[57]  L. Schauble,et al.  Design Experiments in Educational Research , 2003 .

[58]  Andrew Shouse,et al.  Learning science in informal environments : people, places, and pursuits , 2009 .

[59]  David R. Holtgrave,et al.  Bridging the gap between the science and service of HIV prevention: transferring effective research-based HIV prevention interventions to community AIDS service providers. , 2000, American journal of public health.

[60]  Tamara Sumner,et al.  Understanding digital library adoption: a use diffusion approach , 2011, JCDL '11.

[61]  Wiebe E. Bijker,et al.  Science in action : how to follow scientists and engineers through society , 1989 .

[62]  Savitha Moorthy,et al.  Preparing Teachers to Design Sequences of Instruction in Earth Systems Science , 2011 .

[63]  Barry Fishman,et al.  Linking Teacher and Student Learning to Improve Professional Development in Systemic Reform. , 2003 .

[64]  Karen Gallas,et al.  Talking their way into science : hearing children's questions and theories, responding with curricula , 1995 .

[65]  What Can I Do? Voices of Advocacy. , 2000 .

[66]  Barry Fishman,et al.  Supporting the Scaling of Innovations: Guiding Teacher Adaptation of Materials by Making Implicit Structures Explicit , 2004, ICLS.

[67]  A. Kelly Design Research in Education: Yes, but is it Methodological? , 2004 .

[68]  Libby Gerard,et al.  Scaling technology-enhanced science curriculum: leadership development in a professional community , 2008, ICLS.

[69]  Thomas M. Smith,et al.  Inquiry-Oriented Instruction in Science: Who Teaches That Way? , 2007 .

[70]  D. Cohen,et al.  Learning Policy: When State Education Reform Works , 2001 .

[71]  Kathleen J. Roth,et al.  Videobased Lesson Analysis: Effective Science PD for Teacher and Student Learning , 2011 .

[72]  Laura M. Desimone,et al.  Effects of Professional Development on Teachers’ Instruction: Results from a Three-year Longitudinal Study , 2002 .

[73]  Chris Dede,et al.  Model-Based Teaching and Learning with BioLogica™: What Do They Learn? How Do They Learn? How Do We Know? , 2004 .

[74]  Angela Calabrese Barton,et al.  Funds of knowledge and discourses and hybrid space , 2009 .

[75]  Leslie R. Herrenkohl,et al.  How Students Come to Be, Know, and Do: A Case for a Broad View of Learning. Learning in Doing: Social, Cognitive and Computational Perspectives. , 2010 .

[76]  Ilana Seidel Horn,et al.  Attending to Problems of Practice: Routines and Resources for Professional Learning in Teachers’ Workplace Interactions , 2010 .

[77]  Ann S. Rosebery,et al.  “The Coat Traps All Your Body Heat”: Heterogeneity as Fundamental to Learning , 2010 .

[78]  S. Woolf The meaning of translational research and why it matters. , 2008, JAMA.

[79]  Heidi B. Carlone,et al.  The Cultural Production of Science in Reform-based Physics: Girls’ Access, Participation, and Resistance , 2004 .

[80]  J. Supovitz,et al.  Planning Ahead: Make Program Implementation More Predictable , 2010 .

[81]  J. Schumm,et al.  The Educational Reform Rating Rubric: Example of a New Tool for Evaluating Complex School Reform Initiatives , 2008 .

[82]  C. Ballenger,et al.  Puzzling Moments, Teachable Moments: Practicing Teacher Research in Urban Classrooms , 2009 .

[83]  Robert H. Tai,et al.  Planning Early for Careers in Science , 2006, Science.

[84]  P. Black,et al.  Classroom Assessment and the National Science Education Standards. , 2001 .

[85]  Richard M. Ingersoll,et al.  Teacher Turnover and Teacher Shortages: An Organizational Analysis , 2001 .

[86]  Brian Rowan The Ecology of School Improvement: Notes on the School Improvement Industry in the United States , 2002 .

[87]  Joseph Krajcik,et al.  Standardized Test Outcomes for Students Engaged in Inquiry-Based Science Curricula in the Context of Urban Reform. , 2008 .

[88]  Ricardo Nemirovsky,et al.  Everyday Matters in Science and Mathematics: Studies of Complex Classroom Events. , 2005 .

[89]  Phil Scott,et al.  Learning from and responding to students' questions: The authoritative and dialogic tension , 2009 .

[90]  Luli Stern,et al.  Analysis of students' assessments in middle school curriculum materials: Aiming precisely at benchmarks and standards , 2002 .

[91]  Ilana Seidel Horn,et al.  Teaching Replays, Teaching Rehearsals, and Re-Visions of Practice: Learning from Colleagues in a Mathematics Teacher Community , 2010, Teachers College Record: The Voice of Scholarship in Education.

[92]  E. Lopez,et al.  Cultural brokers: helping Latino children on pathways toward success. , 1999, The Future of children.

[93]  Adam V. Maltese,et al.  Eyeballs in the Fridge: Sources of early interest in science , 2010 .

[94]  J. Grimshaw,et al.  Educational strategies to promote evidence‐based community pharmacy practice: a cluster randomised controlled trial , 2001, Family practice.

[95]  Jessica Thompson,et al.  Developing a Theory of Ambitious Early-Career Teacher Practice , 2013 .

[96]  G. Hein Learning Science in Informal Environments: People, Places, and Pursuits , 2009 .

[97]  Jeannett Martin Factual Writing: Exploring and Challenging Social Reality , 1989 .

[98]  H. Schweingruber,et al.  TAKING SCIENCE TO SCHOOL: LEARNING AND TEACHING SCIENCE IN GRADES K-8 , 2007 .

[99]  Jonathan Osborne,et al.  Students' questions and discursive interaction: Their impact on argumentation during collaborative group discussions in science , 2010 .

[100]  Jeannie Oakes,et al.  Multiplying Inequalities: The Effects of Race, Social Class, and Tracking on Opportunities to Learn Mathematics and Science , 1990 .

[101]  J. Krajcik,et al.  Supporting Science Teacher Learning: The Role of Educative Curriculum Materials , 2002 .

[102]  J. Shea National Science Education Standards , 1995 .

[103]  Daniel L. Schwartz,et al.  Toward Teachers' Adaptive Metacognition , 2005 .

[104]  Jonathan A. Supovitz,et al.  The Effects of Professional Development on Science Teaching Practices and Classroom Culture , 2000 .

[105]  Venessa Keesler,et al.  Scaling-Up Exemplary Interventions , 2006 .

[106]  James P. Spillane,et al.  Implementing State Standards for Science Education: What District Policy Makers Make of the Hoopla. , 2000 .

[107]  Robert F. Boruch,et al.  Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination , 2005, Prevention Science.

[108]  Joseph Krajcik,et al.  Inquiry-based science in the middle grades: Assessment of learning in urban systemic reform , 2004 .

[109]  Okhee Lee,et al.  Teaching science to English language learners , 2010 .

[110]  M. Knapp,et al.  Investing in the renewal of urban science teaching , 2001 .

[111]  Ben Kelcey,et al.  How and when does complex reasoning occur? Empirically driven development of a learning progression focused on complex reasoning about biodiversity , 2009 .

[112]  Ann Lieberman,et al.  Inside the National Writing Project: Connecting Network Learning and Classroom Teaching , 2002 .

[113]  D. Medin,et al.  Cultural mosaics and mental models of nature , 2007, Proceedings of the National Academy of Sciences.

[114]  Z. Hong-xi Comment on U.S 2010"A Framework for Science Education-Preliminary Public Draft" , 2011 .

[115]  William R. Penuel,et al.  Teaching for Understanding in Earth Science: Comparing Impacts on Planning and Instruction in Three Professional Development Designs for Middle School Science Teachers , 2009 .

[116]  Catherine E. Snow,et al.  Strategic Education Research Partnership. , 2003 .

[117]  Political and Cultural Dimensions of Organizing Learning around Funds of Knowledge , 2010, Teachers College Record: The Voice of Scholarship in Education.

[118]  Anthony S. Bryk,et al.  Coherence : What It Is and Why It Should Guide School Improvement Policy , 2002 .

[119]  David A. Gillam,et al.  A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas , 2012 .