Supporting the use of learning objects in the K-12 environment: A design-based research project

Abstract This paper outlines the methodology behind a Design- Based Research project conducted at the University ofWollongong. The focus of the research project was on the systematic development of a support system to aidK-12 teachers as they integrated learning designs with learning objects. The foundations of the supportsystem were based on a combination of existing design theories and on an analysis of the practical problemsfaced by teachers as they attempted to create effective pedagogical experiences which incorporate learningobjects. The focal point of this paper is the journey through the Design-Based Research process rather thanoutcomes of the project. Publication Details This conference paper was originally published as Cotton, W, Supporting the use of learning ojbects in theK-12 environment: A design-based research project, Proceedings of the Emerging Technologies Conference,University of Wollongong, 18-21 June 2008. This conference paper is available at Research Online: http://ro.uow.edu.au/etc08/6

[1]  Thor A. Anderson.  I Object! Moving beyond Learning Objects to Learning Components. , 2003 .

[2]  Mark Guzdial,et al.  Apprenticeship-based learning environments: a principled approach to providing software-realized scaffolding through hypermedia , 1998 .

[3]  Roy D. Pea,et al.  Addressing the Challenges of Inquiry-Based Learning Through Technology and Curriculum Design , 1999 .

[4]  Nancy Cunniff,et al.  Graphical vs. textual representation: an empirical study of novices' program comprehension , 1987 .

[5]  Jan Herrington,et al.  Teaching and learning online: A beginner's guide to e-learning and e-teaching in higher education , 2001 .

[6]  Susan McKenney,et al.  Computer-based support for curriculum designers: A case of developmental research , 2005 .

[7]  Michael D. Bush.  Connecting Instructional Design to International Standards for Content Reusability. , 2002 .

[8]  John Barson,et al.  The heuristic dimension of instructional development , 1980 .

[9]  Barry Harper,et al.  A Framework for the Flexible Content Packaging of Learning Objects and Learning Designs , 2004 .

[10]  Susanne P. Lajoie,et al.  Computers as Cognitive Tools: No More Walls , 2000 .

[11]  Vijay V. Raghavan,et al.  Information Retrieval on the World Wide Web , 1997, IEEE Internet Comput..

[12]  M. Patton.  Qualitative research and evaluation methods , 1980 .

[13]  Martin Šurina,et al.  The National Science Digital Library , 2008 .

[14]  Karen Belfer,et al.  Pedagogical Patterns for Online Learning , 2003 .

[15]  M. David Merrill,et al.  The IDXelerator™: Learning-centered Instructional Design , 1999 .

[16]  Diana Laurillard.  Design tools for e-learning , 2002, ASCILITE.

[17]  Rob Phillips,et al.  Field Review of the Schools Online Curriculum Content Initiative , 2004 .

[18]  Sue Bennett,et al.  Investigating how learning designs can be used as a framework to incorporate learning objects , 2004 .

[19]  A. Milson.  Fostering Civic Virtue in a High-Tech World. , 2001 .

[20]  Tim Hand.  Learning Objects: User Perspectives on the Conditions Surrounding Their Use , 2004 .

[21]  Shu-Sheng Liaw,et al.  Information retrieval from the World Wide Web: a user-focused approach based on individual experience with search engines , 2006, Comput. Hum. Behav..

[22]  John Woollard,et al.  The Implications of the Pedagogic Metaphor for Teacher Education in Computing , 2005 .

[23]  Thomas C. Reeves,et al.  Design research from a technology perspective , 2006 .

[24]  Chris Quintana,et al.  Designing for learning , 2003, CHI Extended Abstracts.

[25]  M. David Merrill.  Instructional Transaction Theory: Knowledge Relationships among Processes, Entities, and Activities , 1993 .

[26]  P. R. Freebody.  Does the use of online curriculum content enhance motivation, engagement and learning? The Le@rning Federation Trial Review , 2005 .

[27]  Trevor Wood-Harper,et al.  Multiview - An Exploration in Information Systems Development , 1986, Aust. Comput. J..

[28]  Peter Goodyear,et al.  Educational design and networked learning: Patterns, pattern languages and design practice , 2005 .

[29]  Robin Mason,et al.  Keeping the learning in learning objects , 2003 .

[30]  Richard Horn,et al.  Electronic performance support systems , 1997, CACM.

[31]  Yuen-Yan Chan,et al.  Teaching queueing theory with an inquiry-based learning approach: A case for applying webquest in a course in simulation and statistical analysis , 2007, 2007 37th Annual Frontiers In Education Conference - Global Engineering: Knowledge Without Borders, Opportunities Without Passports.

[32]  Peter Goodyear,et al.  Patterns , pattern languages and educational design , 2004 .

[33]  Ard W. Lazonder,et al.  Do two heads search better than one? Effects of student collaboration on web search behaviour and search outcomes , 2005, Br. J. Educ. Technol..

[34]  Norm Friesen,et al.  What are Educational Objects? , 2001, Interact. Learn. Environ..

[35]  Abbie Brown,et al.  Design experiments: Theoretical and methodological challenges in creating complex interventions in c , 1992 .

[36]  Gloria J. Gery,et al.  Electronic performance support systems: how and why to remake the workplace through the strategic application of technology , 1991 .

[37]  Diana Laurillard,et al.  Reusable educational software: a basis for generic learning activities , 2003 .

[38]  Kuo-En Chang,et al.  The Effect of Concept Mapping to Enhance Text Comprehension and Summarization , 2002 .

[39]  Pithamber R. Polsani,et al.  Use and Abuse of Reusable Learning Objects , 2006, J. Digit. Inf..

[40]  Mike Sosteric,et al.  When is a Learning Object not an Object: A first step towards a theory of learning objects , 2002 .

[41]  Bob Banks,et al.  Learning Theory and Learning Objects , 2001 .

[42]  Malgorzata S. Zywno,et al.  The Effect of Individual Learning Styles on Student Outcomes in Technology-enabled Education* , 2002 .

[43]  Brent G. Wilson.  Evolution of Learning Technologies: From Instructional Design to Performance Support to Network Systems. , 1999 .

[44]  Terry Anderson,et al.  Feasibility of Course Development Based on Learning Objects: Research Analysis of Three Case Studies , 2004 .

[45]  Erik Duval,et al.  Reusable learning objects: a survey of LOM-based repositories , 2002, MULTIMEDIA '02.

[46]  Brian J. Reiser,et al.  Why scaffolding should sometimes make tasks more difficult for learners , 2002, CSCL.

[47]  Daniel D. Suthers.  Evaluating the Learning Object Metadata for K-12 educational resources , 2001, Proceedings IEEE International Conference on Advanced Learning Technologies.

[48]  Erik Duval,et al.  User Behavior in Learning Object Repositories: An Empirical Analysis , 2004 .

[49]  Becky Smerdon,et al.  Teachers' Tools for the 21st Century: A Report on Teachers' Use of Technology. Statistical Analysis Report. , 2000 .

[50]  Grant Mccracken.  The long interview , 1988 .

[51]  Paul Cobb,et al.  Conducting Teaching Experiments in Collaboration With Teachers , 2000 .

[52]  Y. Lincoln,et al.  Scientific Research in Education , 2004 .

[53]  Daniel D. Suthers,et al.  Developing Educational Software Components , 1999, Computer.

[54]  L. Schauble,et al.  Symbolic communication in mathematics and science: Co-constituting inscription and thought. , 2002 .

[55]  Margarita Todorova,et al.  Learning objects , 2003, CompSysTech '03.

[56]  Fred Garnett,et al.  Colloquium , 2008, Br. J. Educ. Technol..

[57]  Martyn Wild,et al.  Designing and evaluating an educational performance support system , 2000, Br. J. Educ. Technol..

[58]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[59]  Paris Avgeriou,et al.  Towards a Pattern Language for Networked Learning , 2004 .

[60]  David McRae,et al.  Evaluating The Le@rning Federation’s online Curriculum content initiative: Summary of findings from surveys, site visits and a field experiment , 2007 .

[61]  Richard Kammann,et al.  The Comprehensibility of Printed Instructions and the Flowchart Alternative , 1975 .

[62]  Thomas C. Reeves,et al.  Design research: A socially responsible approach to instructional technology research in higher education , 2005, J. Comput. High. Educ..

[63]  R. Sitgreaves.  Psychometric theory (2nd ed.). , 1979 .

[64]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[65]  Baltasar Fernández-Manjón,et al.  Creating cost-effective adaptative educational hypermedia based on markup technologies and e-learning standards , 2002 .

[66]  E. Guba.  Criteria for assessing the trustworthiness of naturalistic inquiries , 1981 .

[67]  Andrew S. Gibbons.  Explore, Explain, Design , 2005 .

[68]  Thomas C. Reeves,et al.  Enhancing the Worth of Instructional Technology Research through "Design Experiments" and Other Development Research Strategies , 2000 .

[69]  Rachel A. Vannatta,et al.  Teacher Dispositions as Predictors of Classroom Technology Use , 2004 .

[70]  G. Lipscomb.  “I Guess It Was Pretty Fun”: Using WebQuests in the Middle School Classroom , 2003 .

[71]  Winnie O'Grady,et al.  Repurposing learning objects: a sustainable alternative? , 2005 .

[72]  Leslie P. Steffe,et al.  Teaching experiment methodology: Underlying principles and essential elements , 2000 .

[73]  Clark N. Quinn,et al.  Learning Objects and Instruction Components , 2000, J. Educ. Technol. Soc..

[74]  Elizabeth A. Davis,et al.  Scaffolding students' knowledge integration: prompts for reflection in KIE , 2000 .

[75]  F. Baum,et al.  Participatory action research , 2006, Journal of Epidemiology and Community Health.

[76]  Ron Oliver,et al.  Exploring strategies for online teaching and learning , 1999 .

[77]  Patrick McANDREW and Peter Goodyear,et al.  Representing practitioner experiences through learning design and patterns , 2007 .

[78]  Noel Entwistle,et al.  Styles of learning and teaching , 1981 .

[79]  Rob Koper,et al.  Representing the Learning Design of Units of Learning , 2004, J. Educ. Technol. Soc..

[80]  Karen Woo.  Learning through new media objects , 2003 .

[81]  Tuiren A. Bratina,et al.  Preparing Teachers To Use Learning Objects , 2002 .

[82]  Eric Deeson,et al.  Interactive learning systems evaluation , 2004, Br. J. Educ. Technol..

[83]  Caroline M. Crawford,et al.  Focusing Upon Higher Order Thinking Skills: WebQuests and the Learner-Centered Mathematical Learning Environment. , 2002 .

[84]  R. Kozma.  Technology and Classroom Practices : An International Study , 2003 .

[85]  M. Engle.  Book Review: Qualitative Data Analysis: An Expanded Sourcebook (2nd Ed.) , 1999 .

[86]  David H. Jonassen,et al.  Learning to Solve Problems with Technology: A Constructivist Perspective , 2002 .

[87]  Rob Koper,et al.  Combining reusable learning resources and services to pedagogical purposeful units of learning , 2003 .

[88]  Rosenberg Mj,et al.  The origins and evolution of the field. , 1999 .

[89]  Steven W. Villachica,et al.  Performance Support Systems , 1999 .

[90]  Barry Harper,et al.  The Design of Performance Support Systems to Contextualise Generic Learning Designs , 2004 .

[91]  Paul Shabajee.  Primary Multimedia Objects and 'Educational Metadata': A Fundamental Dilemma for Developers of Multimedia Archives , 2002, D Lib Mag..

[92]  Andrew C. Porter,et al.  Does Professional Development Change Teaching Practice? Results from a Three-Year Study. , 2000 .

[93]  Elliot Soloway,et al.  Symphony: a case study in extending learner-centered design through process space analysis , 1999, CHI '99.

[94]  Thomas C. Reeves,et al.  A development research agenda for online collaborative learning , 2004 .

[95]  G. Boulton‐Lewis.  Teaching for quality learning at university , 2008 .

[96]  Jan van den Akker,et al.  Principles and Methods of Development Research , 1999 .

[97]  V. Minichiello,et al.  In-depth Interviewing: Principles, Techniques, Analysis , 2008 .

[98]  M. Lecompte,et al.  Ethnography and Qualitative Design in Educational Research , 1984 .

[99]  Barry Harper,et al.  Supporting the development of pedagogically sound learning environments using learning designs and learning objects , 2005 .

[100]  Ron Oliver,et al.  Discovering and describing accessible and reusable learning designs for higher education , 2006 .

[101]  施國琛,et al.  Sharable Content Object Reference Model (SCORM) , 2008, Encyclopedia of Multimedia.

[102]  Sandy Britain,et al.  A Review of Learning Design:Concept, Specifications and Tools , 2004 .

[103]  Jere Confrey,et al.  Transformative Teaching Experiments through Conjecture-Driven Research Design. , 2000 .

[104]  James Dalziel,et al.  Implementing learning design : the Learning Activity Management System (LAMS) , 2003 .

[105]  Peter Gerjets,et al.  Competent information search in the World Wide Web: Development and evaluation of a web training for pupils , 2008, Comput. Hum. Behav..

[106]  Meredith D. Gall,et al.  Educational Research: An Introduction , 1965 .

[107]  Allison Littlejohn,et al.  Mod4L report: case studies, exemplars and learning designs. Report of the JISC Mod4L project , 2006 .

[108]  Patrick E. Parrish,et al.  The trouble with learning objects , 2004 .

[109]  Rob Koper,et al.  Transforming existing content into reusable Learning Objects , 2003 .

[110]  Pamela T. Northrup,et al.  STEPS: An EPSS Tool for Instructional Planning. , 1998 .

[111]  R. McCormick,et al.  An evaluation of European learning objects in use , 2006 .

[112]  Abbas Tashakkori,et al.  Mixed Methodology: Combining Qualitative and Quantitative Approaches , 1998 .

[113]  Nienke Nieveen,et al.  Designing, evaluating and implementing an innovative learning environment for supporting mathematics education reform in Indonesia: the CASCADE-IMEI study , 2002 .

[114]  Gabriel Gorghiu,et al.  WebQuest in the Classroom - Analysis of its Impact , 2005 .

[115]  Rob Phillips,et al.  Evaluating the use of learning objects in Australian and New Zealand schools , 2008, Comput. Educ..

[116]  J. Bruner,et al.  The role of tutoring in problem solving. , 1976, Journal of child psychology and psychiatry, and allied disciplines.

[117]  Laurence F Johnson,et al.  Elusive Vision: Challenges Impeding the Learning Object Economy , 2003 .

[118]  M. David Merrill,et al.  Instructional Transaction Theory: Instructional Design Based on Knowledge Objects. , 1996 .

[119]  Richard Malinski,et al.  How teachers learn technology best , 2000, J. Educ. Technol. Soc..

[120]  Rob Koper,et al.  Modeling units of study from a pedagogical perspective: the pedagogical meta-model behind EML , 2001 .

[121]  Susan McKenney,et al.  Computer support for curriculum developers: CASCADE , 2002 .

[122]  David H. Jonassen,et al.  Computers in the Classroom: Mindtools for Critical Thinking , 1995 .

[123]  Jack R. Fraenkel,et al.  Educational Research: A Guide to the Process , 1974 .

[124]  W. Cott.  Supporting the use of learning objects in the K-12 environment: A design-based research project , 2008 .

[125]  Barry Raybould,et al.  Performance Support Engineering: Building Performance-Centered Web-based Systems, Information Systems, and Knowledge Management Systems in the 21st Century. , 2000 .

[126]  David M. Kennedy,et al.  Computer-based cognitive tools: Description and design , 2001 .

[127]  Jan Herrington,et al.  Design-based research and doctoral students: Guidelines for preparing a dissertation proposal , 2007 .

[128]  Kursat Cagiltay.  A Design and Development Model for Building Electronic Performance Support Systems. , 2001 .

[129]  David H. Jonassen,et al.  Technology as Cognitive Tools: Learners as Designers , 2009 .

[130]  Barry Harper,et al.  A tool to evaluate the potential for an ICT-based learning design to foster "high-quality learning" , 2002 .

[131]  Barry Raybould,et al.  Performance Support Engineering: An Emerging Development Methodology for Enabling Organizational Learning , 2008 .

[132]  Joi L. Moore,et al.  The Implementation of an Electronic Performance Support System for Teachers: An Examination of Usage, Performance, and Attitudes , 2008 .

[133]  Mark J. W. Lee,et al.  We want to be teachers, not programmers: in pursuit of relevance and authenticity for initial teacher education students studying an information technology subject at an Australian university , 2007 .

[134]  Diana Laurillard,et al.  Towards a Unified E-learning Strategy: Consultation Document , 2003 .

[135]  Patrick McAndrew,et al.  Learning Design, generic service descriptions and universal acid , 2006, J. Educ. Technol. Soc..

[136]  Kent L. Gustafson.  Designing technology-based performance support , 2000 .

[137]  William Milheim.  Instructional Design Issues for Electronic Performance Support Systems , 1997, Br. J. Educ. Technol..

[138]  Norm Friesen,et al.  CanCore: Metadata for Learning Objects , 2002 .

[139]  David Wiley,et al.  Connecting learning objects to instructional design theory: A definition, a metaphor, and a taxonomy , 2000 .

[140]  Albert Ip,et al.  What is a learning object, technically? , 2001, WebNet.

[141]  Martin A. Simon.  Research on the Development of Mathematics Teachers: The Teacher Development Experiment , 2000 .

[142]  Barry Raybould,et al.  Solving human performance problems with computers a case study: Building an electronic performance support system , 1990 .

[143]  Susan Colaric,et al.  Instruction for Web Searching: An Empirical Study. , 2003 .

[144]  James Laffey.  Dynamism in Electronic Performance Support Systems , 2008 .

[145]  Susan McKenney,et al.  Computer-based support for science education materials developers in Africa : exploring potentials , 2001 .

[146]  K. Gustafson.  Instructional design fundamentals: clouds on the horizon , 1993 .

[147]  Nienke Nieveen,et al.  Computer support for curriculum developers : A study on the potential of computer support in the domain of formative curriculum evaluation , 1997 .

[148]  Craig A. Berg,et al.  The Quest for the Perfect Weather Forecaster. , 2004 .

[149]  John Wedman,et al.  Adapting instructional design to project circumstance: the layers of necessity model , 1991 .

[150]  Iris Tabak,et al.  BGuILE: Stragtegic and conceptual scaffolds for scientific inquiry in biology classrooms , 2001 .

[151]  Erik Duval,et al.  Finding Appropriate Learning Objects: An Empirical Evaluation , 2005, ECDL.

[152]  Kristina Love,et al.  Can one size fit all? The case study of a cd rom in teacher education , 2002, ASCILITE.

[153]  Corrado Poli,et al.  Design for Stamping: Identifying Pedagogically Effective Components in Multimedia Tutors and the Classroom , 2003 .