The "compleat" design experiment: from soup to nuts

INTRODUCTION In this paper, we articulate a methodology for design experiments and situate it within the larger cycle of design in educational settings beginning with the initial conceptualization of design problems to the dissemination of educational products, hence the impetus for the second part of our title: From soup to nuts. The term " design " is used by a variety of fields ranging from art to engineering. In education, the type of research associated with the development of curricular products, intervention strategies, or software tools has been designated as " design research " (e.g., Brown, 1992; Collins 1992). In recent years, the number of investigators associating their work with this genre has become more prevalent in the literature and the focus of special issues in prominent journals in education including paper contributes to the collective attempt of the field of education to further clarify methods and perspectives on design research. Evidenced by the diversity of views incorporated in this book ranging from product development to children as designers, it is clear that design research is a complex endeavour. To begin our contribution to the conversation, we employ the theory of design from the engineering sciences as a useful analogy. Education research has been previously associated with an engineering process (as opposed to the sciences) by a number of 2003). These research programs warrant revisiting the metaphors and analogies used to guide their work in design research. To a certain degree, a large portion of mainstream education research is engineering if what we mean by engineering is to design products and systems that solve problems of import to society. This paper describes the concept of design from an engineering perspective, touching on the distinction between design and artifact. The meat of the paper (following the soup to nuts reference) presents a cyclic model of the overall design process and provides a detailed analysis of design experimentation and the role it assumes in the comprehensive cycle.. Finally, we present an extended example of a program of research that conforms to our notion of design experimentation. In the field of engineering, design is considered the essence of the profession. Engineers design. That is what they do. The emphasis of the word in this context is twofold-relating to design as the practices of engineering, and designs, the intellectual products that 1 those practices engender. As such, in the grammar we are attempting to …

[1]  E. Rogers,et al.  Diffusion of Innovations , 1964 .

[2]  David F. Channell Pasteur's Quadrant: Basic Science and Technological Innovation , 1999 .

[3]  Richard Lesh,et al.  Rational number, ratio and proportion , 1992 .

[4]  Carole Torgerson,et al.  The Need for Randomised Controlled Trials in Educational Research , 2001 .

[5]  Thomas C. Reeves,et al.  Enhancing the Worth of Instructional Technology Research through "Design Experiments" and Other Development Research Strategies , 2000 .

[6]  Karl T. Ulrich,et al.  Product Design and Development , 1995 .

[7]  Tom Carney Fourth Generation Evaluation , 1991 .

[8]  James A. Middleton,et al.  The Emergence of Quotient Understandings in a Fifth-Grade Classroom: A Classroom Teaching Experiment. , 2001 .

[9]  Donovan A. McFarlane,et al.  Evaluating Training Programs: The Four Levels , 2006 .

[10]  Leslie P. Steffe,et al.  Teaching experiment methodology: Underlying principles and essential elements , 2000 .

[11]  M. Gibbons Mode 2 society and the emergence of context-sensitive science , 2000 .

[12]  Y. Lincoln,et al.  Scientific Research in Education , 2004 .

[13]  Thomas E. Kieren,et al.  Rational and fractional numbers: From quotient fields to recursive understanding , 1993 .

[14]  Thomas A. Romberg,et al.  Rational numbers : an integration of research , 1993 .

[15]  Jere Confrey,et al.  On Evaluating Curricular Effectiveness: Judging the Quality of K-12 Mathematics Evaluations. , 2004 .

[16]  Lyn D. English,et al.  Handbook of International Research in Mathematics Education , 2002 .

[17]  Stephen Gorard,et al.  Fostering Scepticism: The Importance of Warranting Claims , 2002 .

[18]  D. C. Phillips,et al.  On the Science of Education Design Studies , 2003 .

[19]  유창조 Naturalistic Inquiry , 2022, The SAGE Encyclopedia of Research Design.

[20]  Allan Collins,et al.  Toward a Design Science of Education , 1992 .

[21]  Kemper Lewis,et al.  A comprehensive robust design approach for decision trade-offs in complex systems design , 2001 .

[22]  L. Shulman Those Who Understand: Knowledge Growth in Teaching , 1986 .

[23]  Soren Bisgaard The Role of Scientific Problem Solving and Statistics in Quality Improvement: Some Perspectives , 1997 .

[24]  Peter Bryant,et al.  Design Experiments and Laboratory Approaches to Learning: Steps Toward Collaborative Exchange , 2003 .

[25]  Douglas A. Grouws,et al.  Handbook of research on mathematics teaching and learning , 1992 .

[26]  James O. Carey,et al.  The systematic design of instruction , 1978 .

[27]  THE DEVELOPMENT OF CHILDREN ’ S UNDERSTANDING OF THE QUOTIENT : A TEACHING EXPERIMENT , 2004 .

[28]  A FRAMEWORK FOR DEVELOPMENT AND EVALUATION OF RCTs FOR COMPLEX INTERVENTIONS TO IMPROVE HEALTH , 2000 .

[29]  P. Sandercock,et al.  Framework for design and evaluation of complex interventions to improve health , 2000, BMJ : British Medical Journal.

[30]  C. Vanderbilt The Jasper experiment: An exploration of issues in learning and instructional design , 1992 .

[31]  Finbarr C. Sloane,et al.  Exploring Modeling Aspects of Design Experiments , 2003 .

[32]  H. Borko Professional Development and Teacher Learning: Mapping the Terrain , 2004 .

[33]  R. Jaeger,et al.  Complementary Methods for Research in Education , 1988 .

[34]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[35]  John Wedman,et al.  Context‐Sensitive Instructional Design Models: A Response to Design Research, Studies, and Criticism , 2008 .

[36]  Adri Smaling,et al.  Inductive, Analogical, and Communicative Generalization , 2003 .

[37]  Stephen Gorard,et al.  Combining Methods in Educational and Social Research , 2004 .

[38]  Steven J. Fenves,et al.  A MODEL FOR INFORMATION FLOW IN DESIGN , 2000 .

[39]  Abbie Brown,et al.  Design experiments: Theoretical and methodological challenges in creating complex interventions in c , 1992 .

[40]  Javier P. Gonzalez-Zugasti,et al.  Modular product architecture , 2001 .

[41]  Anthony E. Kelly,et al.  Clinical Design Sciences: A View From Sister Design Efforts , 2003 .

[42]  Brenda Bannan-Ritland,et al.  The Role of Design in Research: The Integrative Learning Design Framework , 2003 .