Expanding Evidence Approaches for Learning in a Digital World.

The mention of trade names, commercial products or organizations in this report does not imply endorsements by the U.S. government. This publication also contains URLs for information created and maintained by private organizations. This information is provided for the reader's convenience. The U.S. Department of Education is not responsible for controlling or guaranteeing the accuracy, relevance, timeliness or completeness of this information. Further, the inclusion of information or URL does not reflect the importance of the organization, nor is it intended to endorse any views expressed, or products or services offered. Requests for alternate format documents such as Braille or large print should be submitted to the Alternate Format Center by calling 202-260-0852 or by contacting the 504 coordinator via email at om_eeos@ed.gov.

[1]  R. Clark,et al.  Cognitive task analysis for training , 1996 .

[2]  Kenneth R. Koedinger,et al.  Teachers' and Researchers' Beliefs about the Development of Algebraic Reasoning. , 2000 .

[3]  Robert G. M. Hausmann,et al.  Testing the Split Attention Effect on Learning in a Natural Educational Setting Using an Intelligent Tutoring System for Geometry , 2012, CogSci.

[4]  Russell W. Rumberger,et al.  Dropping Out: Why Students Drop Out of High School and What Can Be Done About It , 2011 .

[5]  T. Boat,et al.  Preventing Mental, Emotional, and Behavioral Disorders Among Young People: Progress and Possibilities , 2009 .

[6]  Chris Dede,et al.  Next Generation Assessments for Measuring Complex Learning in Science , 2011 .

[7]  Marsha C. Lovett,et al.  The Open Learning Initiative: Measuring the Effectiveness of the OLI Statistics Course in Accelerating Student Learning. , 2008 .

[8]  Neil T. Heffernan,et al.  Addressing the assessment challenge with an online system that tutors as it assesses , 2009, User Modeling and User-Adapted Interaction.

[9]  Chris Dede,et al.  Digital Teaching Platforms: Customizing Classroom Learning for Each Student. Technology & Education, Connections (TEC). , 2012 .

[10]  Chris Dede,et al.  Immersive Interfaces for Engagement and Learning , 2009, Science.

[11]  Chris Dede,et al.  Interweaving Assessments Into Immersive Authentic Simulations: Design Strategies for Diagnostic and Instructional Insights , 2012 .

[12]  K. Fernow.  New York , 1896, American Potato Journal.

[13]  John Unsworth.  University 2.0 , 2007 .

[14]  Identifiers Jamaica,et al.  Annual Meeting of the National Association for Research in Science Teaching , 2000 .

[15]  Russell G. Almond,et al.  You Can't Fatten A Hog by Weighing It - Or Can You? Evaluating an Assessment for Learning System Called ACED , 2008, Int. J. Artif. Intell. Educ..

[16]  Lyndsay Pinkus,et al.  Using Early-Warning Data to Improve Graduation Rates: Closing Cracks in the Education System. Policy Brief. , 2008 .

[17]  Tamara Sumner,et al.  Customizing science instruction with educational digital libraries , 2010, JCDL '10.

[18]  Daniel L. Schwartz,et al.  Rethinking transfer: A simple proposal with multiple implica-tions , 1999 .

[19]  Ryan Shaun Joazeiro de Baker,et al.  Off-task behavior in the cognitive tutor classroom: when students "game the system" , 2004, CHI.

[20]  Kenneth A. Frank,et al.  Quantifying Discourse about Causal Inferences 1 Quantifying Discourse about Causal Inferences from Randomized Experiments and Observational Studies in Social Science Research , 2011 .

[21]  Jeremy D. Finn,et al.  How to Make the Dropout Problem Go Away. , 1991 .

[22]  W. Penuel,et al.  Organizing Research and Development at the Intersection of Learning, Implementation, and Design , 2011 .

[23]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[24]  Lorrie A. Shepard,et al.  Will National Tests Improve Student Learning , 1991 .

[25]  Marie Bienkowski,et al.  Enhancing Teaching and Learning Through Educational Data Mining and Learning Analytics: An Issue Brief , 2012 .

[26]  Matthew M. Chingos,et al.  Choosing Blindly: Instructional Materials, Teacher Effectiveness, and the Common Core. , 2012 .

[27]  Eileen M. Foley,et al.  EVALUATION OF NEW CENTURY HIGH SCHOOLS Profile of an Initiative to Create and Sustain Small, Successful High Schools , 2007 .

[28]  M. McDaniel,et al.  Learning Styles , 2008, Psychological science in the public interest : a journal of the American Psychological Society.

[29]  Aaron K. Chatterji,et al.  Harnessing Technology to Improve K–12 Education , 2012 .

[30]  Lee J. Cronbach,et al.  Individual Differences in Learning Ability as a Function of Instructional Variables. Final Report. , 1969 .

[31]  John J. Koran,et al.  Aptitude-treatment interaction research in science education , 1984 .

[32]  Kimberly E. Arnold.  Signals: Applying Academic Analytics. , 2010 .

[33]  D. Clements.  Subitizing: What Is It? Why Teach It?. , 1999 .

[34]  D. Phillips,et al.  From Neurons to Neighborhoods: The Science of Early Childhood Development , 2000 .

[35]  William H. Schmidt,et al.  Curricular Coherence and the Common Core State Standards for Mathematics , 2012 .

[36]  Joe Ksander.  Gear , 2015, SIGGRAPH Computer Animation Festival.

[37]  W. Shadish,et al.  The renaissance of field experimentation in evaluating interventions. , 2009, Annual review of psychology.

[38]  R. Mayer.  Systematic Thinking Fostered by Illustrations in Scientific Text , 1989 .

[39]  J. D. Fletcher,et al.  DARPA Education Dominance Program: April 2010 and November 2010 Digital Tutor Assessments , 2011 .

[40]  Jennifer A. Fredricks,et al.  Is extracurricular participation associated with beneficial outcomes? Concurrent and longitudinal relations. , 2006, Developmental psychology.

[41]  Eva L. Baker,et al.  Templates and Objects in Authoring Problem-Solving Assessments. CRESST Report 735. , 2008 .

[42]  Open Badges for Lifelong Learning , 2012 .

[43]  E. Mazur,et al.  Peer Instruction: Ten years of experience and results , 2001 .

[44]  Earl R. Glenn,et al.  National association for research in science teaching: National association for research in science teaching , 1929 .

[45]  Milbrey W. McLaughlin,et al.  Urban Sanctuaries: Neighborhood Organizations in the Lives and Futures of Inner City Youth , 2001 .

[46]  R. Mayer,et al.  Testing the ATI hypothesis: Should multimedia instruction accommodate verbalizer-visualizer cognitive style? ! , 2006 .

[47]  Melissa Koch,et al.  Engaging Youth with STEM Professionals in Afterschool Programs , 2012 .

[48]  Fred M. Newmann,et al.  Continuing the bifurcation of affect and cognition , 1996 .

[49]  P. Simon.  Community Programs to Promote Youth Development , 2005 .

[50]  Richard Wainess,et al.  A Conceptual Framework for Assessing Performance in Games and Simulations. CRESST Report 771. , 2010 .

[51]  Gregory J. Cizek,et al.  Sources of Validity Evidence for Educational and Psychological Tests: A Follow-Up Study , 2010 .

[52]  Katie Ash.  K-12 Marketplace Sees Major Flow of Venture Capital. , 2012 .

[53]  Lyle F. Bachman.  Measurement: Interdisciplinary Research and Perspectives , 2013 .

[54]  Slava Kalyuga,et al.  Managing split-attention and redundancy in multimedia instruction , 1999 .

[55]  E. Skinner,et al.  Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year. , 1993 .

[56]  Beverly Park Woolf,et al.  Affect-aware tutors: recognising and responding to student affect , 2009, Int. J. Learn. Technol..

[57]  Jen Harvey,et al.  Designing for learning , 2006 .

[58]  L. Cronbach,et al.  Aptitudes and instructional methods: A handbook for research on interactions , 1977 .

[59]  S. Messick.  The Interplay of Evidence and Consequences in the Validation of Performance Assessments , 1994 .

[60]  R. Glaser,et al.  Knowing What Students Know: The Science and Design of Educational Assessment , 2001 .

[61]  Galit Shmueli,et al.  Predictive Analytics in Information Systems Research , 2010, MIS Q..

[62]  K. Wentzel.  Student motivation in middle school: The role of perceived pedagogical caring. , 1997 .

[63]  Vincent Aleven,et al.  Diagram interaction during intelligent tutoring in geometry: Support for knowledge retention and deep understanding , 2008 .

[64]  William H. Schmidt,et al.  Why Schools Matter: A Cross-National Comparison of Curriculum and Learning , 2001 .

[65]  V. Shute.  SteAlth ASSeSSment in computer-BASed GAmeS to Support leArninG , 2011 .

[66]  J. Lemke,et al.  Documenting and Assessing Learning in Informal and Media-Rich Environments , 2015 .

[67]  Albert T. Corbett,et al.  Cognitive Tutor: Applied research in mathematics education , 2007, Psychonomic bulletin & review.

[68]  R. Almond,et al.  Focus Article: On the Structure of Educational Assessments , 2003 .

[69]  Milbrey W. McLaughlin,et al.  Identity and Inner-City Youth: Beyond Ethnicity and Gender , 1993 .

[70]  G. Wiggins,et al.  Understanding by Design , 1998 .

[71]  A. Corbett,et al.  The Cambridge Handbook of the Learning Sciences: Cognitive Tutors , 2005 .

[72]  Vincent Aleven,et al.  An effective metacognitive strategy: learning by doing and explaining with a computer-based Cognitive Tutor , 2002, Cogn. Sci..

[73]  Lilla Dale McManis,et al.  Finding the Education in Educational Technology with Early Learners. , 2012 .

[74]  I. Biederman,et al.  Sexing Day-Old Chicks : A Case Study and Expert Systems Analysis of a Difficult Perceptual-Learning Task , 1987 .

[75]  J. Pellegrino,et al.  Education for Life and Work: Developing Transferable Knowledge and Skills in the 21st Century , 2013 .

[76]  Angela L. Duckworth,et al.  Personality Psychology and Economics , 2011, SSRN Electronic Journal.

[77]  M. Villano,et al.  Introduction to knowledge spaces: How to build, test, and search them , 1990 .

[78]  J Derek,et al.  Educational Research Association , 1996 .

[79]  Russell G. Almond,et al.  On the Structure of Educational Assessments, CSE Technical Report. , 2003 .

[80]  Louis M. Gomez,et al.  Getting Ideas into Action: Building Networked Improvement Communities in Education , 2010 .

[81]  Kasia Muldner,et al.  Emotion Sensors Go To School , 2009, AIED.

[82]  David Yun Dai,et al.  Design research on learning and thinking in educational settings : enhancing intellectual growth and functioning , 2012 .

[83]  Brigid Barron,et al.  Parents as Learning Partners in the development of t echnological Fluency , 2009 .

[84]  Chris Quintana,et al.  Designing for learning , 2003, CHI Extended Abstracts.

[85]  Marshall S Smith.  Opening Education , 2009, Science.

[86]  Jennifer A. Fredricks,et al.  School Engagement: Potential of the Concept, State of the Evidence , 2004 .

[87]  Shelley Goldman,et al.  Mixing the Digital, Social, and Cultural: Learning, Identity, and Agency in Youth Participation , 2008 .

[88]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[89]  Jacquelynne S. Eccles,et al.  Student Council, Volunteering, Basketball, or Marching Band , 1999 .

[90]  M. Peters,et al.  Transforming American Education: Learning Powered by Technology , 2011 .

[91]  S. Hidi,et al.  The Four-Phase Model of Interest Development , 2006 .

[92]  B. Bloom.  The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring , 1984 .

[93]  Milbrey W. McLaughlin,et al.  Community Counts: How Youth Organizations Matter for Youth Development. , 2000 .

[94]  William W. Wilmot,et al.  Innovation: The Five Disciplines for Creating What Customers Want , 2006 .

[95]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[96]  Donald Rubin,et al.  Estimating Causal Effects from Large Data Sets Using Propensity Scores , 1997, Annals of Internal Medicine.

[97]  Jacquelynne S. Eccles,et al.  Community Programs To Promote Youth Development. , 2002 .

[98]  D. Phillips,et al.  COMMITTEE ON INTEGRATING THE SCIENCE OF EARLY CHILDHOOD DEVELOPMENT , 2000 .

[99]  R. Martorell,et al.  Summary and recommendations. , 2002, The Journal of nutrition.

[100]  Yun-En Liu,et al.  Gameplay analysis through state projection , 2010, FDG.

[101]  M. Coye,et al.  NATIONAL RESEARCH COUNCIL AND INSTITUTE OF MEDICINE , 1998 .

[102]  Scotty D. Craig,et al.  Affect and learning: An exploratory look into the role of affect in learning with AutoTutor , 2004 .

[103]  R. Gardner,et al.  Heath, Shirley Brice , 2012 .

[104]  Richard M. Lerner,et al.  Promoting Community-Based Programs for Socialization and Learning. New Directions for Child Development Series, Number 63. , 1994 .

[105]  Wayne Au,et al.  High-Stakes Testing and Curricular Control: A Qualitative Metasynthesis , 2007 .

[106]  Dr. Alex A. Freitas.  Data Mining and Knowledge Discovery with Evolutionary Algorithms , 2002, Natural Computing Series.

[107]  Kenneth R. Koedinger,et al.  An Investigation of Teachers' Beliefs of Students' Algebra Development , 2000, Cognition and Instruction.

[108]  Elaine M. Allensworth,et al.  What Matters for Staying On-Track and Graduating in Chicago Public Schools: A Focus on Students with Disabilities. Research Report. , 2009 .

[109]  G. Fischer.  CO-EVOLUTION OF LEARNING , NEW MEDIA , AND NEW LEARNING ORGANIZATIONS , 2012 .

[110]  T. Kindermann,et al.  Engagement and Disaffection in the Classroom: Part of a Larger Motivational Dynamic? , 2008 .

[111]  Laura M. O'Dwyer,et al.  A Short History of Performance Assessment: Lessons Learned. , 1999 .

[112]  Ben Hamner,et al.  Contrasting state-of-the-art automated scoring of essays: analysis , 2012 .

[113]  Hugh Mehan,et al.  Educational Reform Implementation: A Co-Constructed Process , 1998 .

[114]  Raymond L. Pecheone,et al.  Gathering Feedback for Teaching Combining High-Quality Observations with Student Surveys and Achievement Gains , 2012 .

[115]  Susan Fairchild,et al.  Student Progress to Graduation in New York City High Schools: A Metric Designed by New Visions for Public Schools. Part I: Core Components. , 2011 .

[116]  Samuel Forest.  Association for Supervision and Curriculum Development , 1955 .

[117]  Zoran Popovic,et al.  Feature-based projections for effective playtrace analysis , 2011, FDG.

[118]  Sebastián Ventura,et al.  Educational Data Mining: A Review of the State of the Art , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[119]  Kenneth R. Koedinger,et al.  Automated Student Model Improvement , 2012, EDM.

[120]  G. Hull,et al.  Literacy and Learning Out of School: A Review of Theory and Research , 2001 .

[121]  Robert J. Mislevy,et al.  Implications of Evidence‐Centered Design for Educational Testing , 2007 .

[122]  George Siemens,et al.  Learning analytics and educational data mining: towards communication and collaboration , 2012, LAK.

[123]  Alan Levine,et al.  The 2010 Horizon Report. , 2010 .

[124]  J. Oakes,et al.  Keeping Track: How Schools Structure Inequality. , 1986 .

[125]  Dc Washington,et al.  Data Quality Campaign. , 2011 .

[126]  Cristina Conati,et al.  Combining Unsupervised and Supervised Classification to Build User Models for Exploratory , 2009, EDM 2009.

[127]  Vincent Aleven,et al.  More Accurate Student Modeling through Contextual Estimation of Slip and Guess Probabilities in Bayesian Knowledge Tracing , 2008, Intelligent Tutoring Systems.