Teachers using classroom data well: Identifying key features of effective practices

The Queensland College of Teachers (QCT) initiated this report as an investigation of the practices associated with Standard 5 of the Australian Professional Standards for Teachers (AITSL, 2011). Related to professional practice, Standard 5 refers to “assess, provide feedback and report on student learning.” This Standard incorporates school executive and teacher understandings of how to collect, analyse, interpret and use systemic and classroom data to support and improve students’ learning. It is argued that the development of teachers’ knowledge and skills in these areas will assist with informing and generating improved student outcomes. Simultaneously the acquisition of such knowledge and skills will empower teachers as they become inquiry-minded and data-literate.

[1]  Lorna Earl,et al.  Using Data in Leadership for Learning , 2003 .

[2]  R. Linn.  Assessments and Accountability , 2000 .

[3]  Sue Swaffield,et al.  Getting to the heart of authentic Assessment for Learning , 2011 .

[4]  Barbara Means,et al.  Teachers' Use of Student Data Systems to Improve Instruction. , 2007 .

[5]  G. Glass.  Teacher Quality and Student Achievement: A Review of State Policy Evidence , 2000 .

[6]  Victoria L. Bernhardt.  Translating Data into Information to Improve Teaching and Learning , 2007 .

[7]  Helen Timperley,et al.  Teacher professional learning and development: Best evidence synthesis iteration , 2007 .

[8]  Janet C. Quint,et al.  Using Student Data to Improve Teaching and Learning Findings from an Evaluation of the Formative Assessments of Student Thinking in Reading (FAST-R) Program in , 2008 .

[9]  D. Royce Sadler,et al.  Assuring academic achievement standards: from moderation to calibration , 2013 .

[10]  R. Stiggins.  From Formative Assessment to Assessment for Learning: A Path to Success in Standards-Based Schools , 2005 .

[11]  But What Do You Do with the Data , 2007 .

[12]  Dylan Wiliam,et al.  Embedded Formative Assessment , 2011 .

[13]  M. Lachat,et al.  Practices That Support Data Use in Urban High Schools , 2005 .

[14]  J. Parr,et al.  Enacting Assessment for Learning: the beliefs practice nexus , 2011 .

[15]  Barbara Y. White,et al.  Designing Assessments for Instruction and Accountability: An Application of Validity Theory to Assessing Scientific Inquiry , 2004, Teachers College Record: The Voice of Scholarship in Education.

[16]  Stephen Gorard.  The Role of Secondary Data in Combining Methodological Approaches , 2002 .

[17]  M. Hill.  ‘Getting traction’: enablers and barriers to implementing Assessment for Learning in secondary schools , 2011 .

[18]  Val Klenowski,et al.  Explicit, latent and meta-criteria: types of criteria at play in professional judgement practice , 2013 .

[19]  M. James,et al.  Assessment in Schools: Fit for Purpose? , 2009 .

[20]  D. Berliner,et al.  High-stakes testing, uncertainty, and student learning , 2002 .

[21]  Data-driven school improvement through the VCE data service , 2005 .

[22]  Ruhama Even,et al.  Using assessment to inform instructional decisions: How hard can it be? , 2005 .

[23]  Mehmet Aydeniz,et al.  Formative Assessment: Improving Learning in Secondary Classrooms , 2009 .

[24]  Nancy Love.  TAKING DATA TO NEW DEPTHS , 2004 .

[25]  Fred M. Newmann,et al.  Accountability and School Performance: Implications from Restructuring Schools , 1996 .

[26]  L. Shepard.  Using Assessment to Improve Learning. , 1995 .

[27]  Using Student Data to Improve Teaching and Learning: Findings from an Evaluation of the Formative Assessments of Students Thinking in Reading (FAST-R) Program in Boston Elementary Schools. , 2008 .

[28]  B. Lingard,et al.  Teachers and schooling : making a difference , 2006 .

[29]  Douglas Huffman,et al.  Collaborative Inquiry to Make Data-Based Decisions in Schools. , 2003 .

[30]  Jeffrey C. Wayman,et al.  Technology‐Supported Involvement of Entire Faculties in Examination of Student Data for Instructional Improvement , 2006, American Journal of Education.

[31]  Viki M. Young.  Teachers’ Use of Data: Loose Coupling, Agenda Setting, and Team Norms , 2006, American Journal of Education.

[32]  Teachers’ perceptions of the factors influencing their engagement with statistical reports on student achievement data , 2013 .

[33]  P. Black,et al.  Inside the Black Box: Raising Standards through Classroom Assessment , 2010 .

[34]  G. Deleuze,et al.  Negotiations, 1972-1990 , 1995 .

[35]  Data for schools in NSW: What is provided and can it help? , 2005 .

[36]  Judy Salpeter.  Data: Mining with a Mission , 2006 .

[37]  J. Gardner.  Assessment and learning , 2006 .

[38]  Jonathan A. Supovitz,et al.  Mapping a Course for Improved Student Learning: How Innovative Schools Systematically Use Student Performance Data to Guide Improvement , 2003 .

[39]  C. Coburn,et al.  Conceptions of Evidence Use in School Districts: Mapping the Terrain , 2006, American Journal of Education.

[40]  David C. Berliner,et al.  Rational responses to high stakes testing: the case of curriculum narrowing and the harm that follows , 2011 .

[41]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[42]  Pasi Sahlberg,et al.  Education policies for raising student learning: the Finnish approach , 2007 .

[43]  Robyn Pierce,et al.  Teachers’ intentions to use national literacy and numeracy assessment data: a pilot study , 2011 .

[44]  P. Freebody,et al.  Towards Research-based Innovation and Reform: Singapore schooling in transition , 2005 .

[45]  Anthony Kelly,et al.  Using Effectiveness Data for School Improvement: Developing and Utilising Metrics , 2010 .

[46]  P. Black,et al.  Lessons from around the world: how policies, politics and cultures constrain and afford assessment practices , 2005 .

[47]  Reg Allen.  Using the evidence of student achievement for improvements at individual, class and school level , 2005 .

[48]  H. Timperley,et al.  Instructional Leadership Challenges: The Case of Using Student Achievement Information for Instructional Improvement , 2005 .

[49]  Victoria L. Bernhardt.  Data, Data Everywhere: Bringing All the Data Together for Continuous School Improvement , 2008 .

[50]  N. Torrance,et al.  Embedding Accountability and Improvement Into Large-Scale Assessment: What Difference Does It Make? , 2000 .

[51]  L. Earl,et al.  Leading Schools in a Data-Rich World , 2002 .

[52]  Rosann Tung,et al.  Whole School Reform: How Schools Use the Data-Based Inquiry and Decision Making Process. , 2001 .

[53]  L. Earl.  From Accounting to Accountability: Harnessing Data for School Improvement , 2005 .

[54]  Richard Halverson.  School Formative Feedback Systems , 2010 .

[55]  Sam Sellar,et al.  ‘Catalyst data’: perverse systemic effects of audit and accountability in Australian schooling , 2013 .

[56]  C. Gipps.  Beyond Testing: Towards a Theory of Educational Assessment , 1994 .

[57]  P. Griffin,et al.  Judgement-based performance measures of literacy for students with additional needs: seeing students through the eyes of experienced special education teachers , 2013 .

[58]  Kim Schildkamp,et al.  Data-based decision making in education: challenges and opportunities , 2013 .

[59]  Lois Quam,et al.  The Audit Society: Rituals of Verification , 1998 .

[61]  Cengiz Tüysüz.  Development of two-tier diagnostic instrument and assess students' understanding in chemistry , 2009 .

[62]  Pasi Sahlberg,et al.  Rethinking accountability in a knowledge society , 2010 .

[63]  P. Black,et al.  Working inside the Black Box: Assessment for Learning in the Classroom , 2004 .

[64]  Shirley Simon,et al.  Learning to argue: A study of four schools and their attempt to develop the use of argumentation as a common instructional practice and its impact on students , 2013 .

[65]  N. Dulfer,et al.  The experience of education: The impacts of high stakes testing on school students and their families , 2012 .

[66]  R. Stiggins.  Assessment Crisis: The Absence of Assessment for Learning , 2002 .

[67]  L. Shepard.  The Role of Assessment in a Learning Culture , 2000 .

[68]  Margaret Wu.  Measurement, Sampling, and Equating Errors in Large‐Scale Assessments , 2010 .

[69]  Moving on from Count Me In Too: Evidence- based teaching and learning in numeracy in the early and middle years of schooling , 2005 .

[70]  Education and Training.  Australian Curriculum, Assessment and Reporting Authority Act 2008 , 2014 .

[71]  L. Darling-Hammond,et al.  Authentic assessment in action : studies of schools and students at work , 1995 .

[72]  Geoff N Masters,et al.  Reforming Educational Assessment: Imperatives, principles and challenges , 2013 .

[73]  R. Tierney.  Changing practices: influences on classroom assessment , 2006 .

[74]  R. Schroeder,et al.  Accountability Policies and Teacher Decision Making: Barriers to the Use of Data to Improve Practice. , 2004 .

[75]  John White,et al.  Accountability and School Inspection: In Defence of Audited Self‐Review , 2001 .

[76]  Valentina Klenowski,et al.  Assessment for learning in the accountability era: queensland, australia , 2011 .

[77]  Kouider Mokhtari,et al.  How One Elementary School Uses Data to Help Raise Students' Reading Achievement , 2009 .

[78]  Julie A. Marsh,et al.  Interventions Promoting Educators’ Use of Data: Research Insights and Gaps , 2012, Teachers College Record: The Voice of Scholarship in Education.

[79]  Kathy Hall,et al.  Reporting to parents in primary school: communication, meaning and learning , 2008 .

[80]  Using assessment information to inform teaching and learning , 2006 .

[81]  Richard P. Phelps.  Defending Standardized Testing , 2005 .

[82]  Margery Ginsberg.  Using Data to Improve Student Learning , 2011 .

[83]  Jane Watson,et al.  School pupil change associated with a continuing professional development programme for teachers , 2011 .

[84]  M. Fullan.  The New Meaning of Educational Change , 1990 .

[85]  Gordon Stobart,et al.  Testing Times: The Uses and Abuses of Assessment , 2008 .

[86]  Muhammad Tahir Mustafa,et al.  National Professional Standards for Teachers in Pakistan in Light of Teaching of the Holy Prophet (P.B.U.H) , 2015 .

[87]  Richard J. Stiggins,et al.  Assessment Literacy for the 21st Century. , 1995 .

[88]  George W. Gagnon,et al.  Learning Circles: Creating Conditions for Professional Development , 1998 .

[89]  M. Honey,et al.  Linking Data and Learning: The Grow Network Study , 2005 .

[90]  S. Sutherland.  Creating a Culture of Data Use for Continuous Improvement: A Case Study of an Edison Project School , 2004 .

[91]  Barbara Means,et al.  Implementing Data-Informed Decision Making in Schools: Teacher Access, Supports and Use. , 2009 .

[92]  J. Williams,et al.  National Testing and the Improvement of Classroom Teaching: Can they coexist? , 2000 .

[93]  Amanda Datnow,et al.  Student Involvement and Data-Driven Decision Making , 2011 .

[94]  L. Allal.  Teachers’ professional judgement in assessment: a cognitive act and a socially situated practice , 2013 .

[95]  D. Duke,et al.  Effective Instructional Leadership Requires Assessment Leadership , 2008 .

[96]  Lisa Petrides.  Using Data to Support School Reform: New Technologies Have Made Data Gathering Easier Than Ever. Educators Now Must Confront One Big Question: How Can the Data Be Used to Improve Student Achievement? , 2006 .

[97]  Clare Lee,et al.  Assessment for learning , 2003, Practical Pedagogy.

[98]  David H. Axworthy.  Turning data into information that improves teaching and learning: the WA experience , 2005 .

[99]  Jennifer Stowe,et al.  The Flat World and Education: How America's Commitment to Equity Will Determine Our Future , 2015 .

[100]  Maryl Gearhart,et al.  Looking at Student Work for Teacher Learning, Teacher Community, and School Reform , 2003 .

[101]  Maria Teresa Tatto,et al.  The Mathematics Education of Future Primary and Secondary Teachers: Methods and Findings from the Teacher Education and Development Study in Mathematics , 2011 .

[102]  Mary Hill,et al.  Ways of seeing: using ethnography and Foucault's `toolkit' to view assessment practices differently , 2009 .

[103]  Julie A. Marsh,et al.  Strategies to Promote Data Use for Instructional Improvement: Actions, Outcomes, and Lessons fromThree Urban Districts , 2006, American Journal of Education.

[104]  Using Data to Improve Student , 2008 .

[105]  Cris Tovani,et al.  So What Do They Really Know?: Assessment That Informs Teaching and Learning , 2011 .

[106]  M. Goos,et al.  Development and application of a two-tier diagnostic instrument to assess middle-years students’ proportional reasoning , 2013 .

[107]  John F. Pane,et al.  Making Sense of Data-Driven Decision Making in Education , 2006 .

[108]  Christopher A. Thorn.  The Challenges of Implementing Data Based Decision-Making at the School Level , 2007 .

[109]  M. Carter.  Visible learning: a synthesis of over 800 meta‐analyses relating to achievement , 2009 .

[110]  Gabrielle Matters,et al.  Using Data to Support Learning in Schools: Students, Teachers, Systems. Australian Education Review Number 49. , 2006 .

[111]  Tonya R. Moon.  The Role of Assessment in Differentiation , 2005 .

[112]  John Hattie,et al.  Assessment and Classroom Learning: a deductive approach , 1998 .

[113]  Linda Sturman,et al.  Schools' Use of Data in Teaching and Learning. Research Report RR671. , 2005 .

[114]  Jeffrey C. Wayman,et al.  Involving Teachers in Data-Driven Decision Making: Using Computer Data Systems to Support Teacher Inquiry and Reflection , 2005 .

[115]  Lorna Earl,et al.  Perspectives on Alternative Assessment Reform , 2002 .

[116]  P. Pettit.  From data-informed to data-led?: School leadership within the context of external testing , 2009 .