Teachers' Cloud-Based Learning Designs: The Development of a Guiding Rubric Using the TPACK Framework

ABSTRACT This study aimed to develop, validate, and trial a rubric for evaluating the cloud-based learning designs (CBLD) that were developed by teachers using virtual learning environments. The rubric was developed using the technological pedagogical content knowledge (TPACK) framework, with rubric development including content and expert validation of its items and levels. The rubric was revised based on various types of input including content validity and expert review. After many iterations of rubric implementation using two raters, the final version of the rubric was found to be reliable with high and substantial inter-rater reliability. This study provides a methodological contribution by developing and validating a rubric for teachers' cloud-based learning designs. It also provides a useful tool for evaluating the quality of teachers' CBLD, and assessing training needs.

[1]  Jane Seale,et al.  Mapping pedagogy and tools for effective learning design , 2004, Comput. Educ..

[2]  Martin Oliver,et al.  Handbook of technological pedagogical content knowledge (TPCK) for educators , 2011 .

[3]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[4]  Elizabethann O’Sullivan,et al.  Research Methods for Public Administrators , 1994 .

[5]  Mark J. Hofer,et al.  Testing a TPACK-Based Technology Integration Observation Rubric , 2011 .

[6]  Armando Eduardo De Giusti,et al.  Cloud Computing. Concepts, Technology & Architecture , 2013 .

[7]  Daniel Burgos,et al.  Practical and Pedagogical Issues for Teacher Adoption of IMS Learning Design Standards in Moodle LMS , 2005 .

[8]  Francisco Herrera,et al.  An Overview of E-Learning in Cloud Computing , 2012 .

[9]  L. Shulman.  Knowledge and Teaching: Foundations of the New Reform , 1987 .

[10]  Elizabeth A. Moore,et al.  Computers in Schools. , 1988 .

[11]  Darren George,et al.  SPSS for Windows Step by Step: A Simple Guide and Reference , 1998 .

[12]  Franca Garzotto,et al.  A Critical Perspective on Design Patterns for E-Learning , 2008 .

[13]  James Dalziel.  Learning design : sharing pedagogical know-how , 2008 .

[14]  Ammar Rashid,et al.  Toward the Trend of Cloud Computing , 2011 .

[15]  Steven E. Stemler,et al.  Best Practices in Interrater Reliability Three Common Approaches , 2008 .

[16]  Charles R. Graham,et al.  TPACK Development in Science Teaching: Measuring the TPACK Confidence of Inservice Science Teachers , 2009 .

[17]  Judi Harris,et al.  What Is Technological Pedagogical Content Knowledge , 2009 .

[18]  Ron Oliver,et al.  Exploring strategies for online teaching and learning , 1999 .

[19]  Peter Goodyear,et al.  Educational design and networked learning: Patterns, pattern languages and design practice , 2005 .

[20]  Lee Yong Tay,et al.  TPACK-in-Action: Unpacking the contextual influences of teachers' construction of technological pedagogical content knowledge (TPACK) , 2014, Comput. Educ..

[21]  Mark J. Hofer,et al.  TPACK Development in Teacher Education , 2012 .

[22]  Jessaca K. Spybrook.  Methods in Educational Research: From Theory to Practice , 2008 .

[23]  J. Koh.  A rubric for assessing teachers' lesson activities with respect to TPACK for meaningful learning with ICT , 2013 .

[24]  Utpal M. Dholakia,et al.  What Makes an Open Education Program Sustainable? The Case of Connexions , 2006 .

[25]  Doris McGartland Rubio.  Content Validity , 2022, The SAGE Encyclopedia of Research Design.

[26]  IMS learning design best practice and implementation guide - version 1.0 final specification , 2003 .

[27]  Mark J. Hofer,et al.  Testing a TPACK-Based Technology Integration Assessment Rubric , 2010 .

[28]  Barry Harper,et al.  Learning designs: Bridging the gap between theory and practice , 2007 .

[29]  Michael C. Rodriguez,et al.  Developing and Validating Test Items , 2013 .

[30]  C. Powell.  The Delphi technique: myths and realities. , 2003, Journal of advanced nursing.

[31]  Matthew J. Koehler,et al.  Technological Pedagogical Content Knowledge: A Framework for Teacher Knowledge , 2006, Teachers College Record: The Voice of Scholarship in Education.

[32]  Will Gibson.  Qualitative Research as a Method of Inquiry in Education , 2010, Educational Research and Inquiry.

[33]  William H. Dutton,et al.  Clouds, big data, and smart assets: Ten tech-enabled business trends to watch , 2010 .

[34]  Nmc.  NMC Horizon Report: 2015 K-12 Edition , 2015 .

[35]  곽영숙.  테크놀로지 교과교육학 지식(TPACK-Technology Pedagogical And Content Knowledge)에 대한 유아교사의 인식 , 2016 .

[36]  Charles R. Graham,et al.  The Technological Pedagogical Content Knowledge Framework , 2014 .

[37]  L. Shulman.  Those Who Understand: Knowledge Growth in Teaching , 1986 .

[38]  Toru Iiyoshi,et al.  Opening Up Education: The Collective Advancement of Education through Open Technology, Open Content, and Open Knowledge , 2008 .

[39]  Arafeh Karimi,et al.  Teachers cloud-based content creation in light of the TPACK Framework: implications for teacher education , 2015 .

[40]  Md. Saifuddin Khalid,et al.  The Potentials of Using Cloud Computing in Schools: A Systematic Literature Review , 2017 .

[41]  Gráinne Conole,et al.  Learning design - making practice explicit , 2010 .

[42]  Matthew J. Koehler,et al.  What Happens When Teachers Design Educational Technology? The Development of Technological Pedagogical Content Knowledge , 2005 .

[43]  Matthew J. Koehler.  What happens when teachers design educational technology , 2005 .