Examining the TPACK framework through the convergent and discriminant validity of two measures

Abstract The purpose of this multiple case study was to critically evaluate the Technological Pedagogical Content Knowledge (TPACK) framework by examining the convergent and discriminant validity associated with two popular TPACK measures. Twenty-seven preservice teachers completed the Schmidt et al. (2009) survey and their planning documents were analyzed using the Harris et al. (2010) rubric. A Spearman rank order correlation on the two measures revealed low levels of convergence within similar constructs and a lack of discrimination between dissimilar constructs. Holistic narrative analysis of end-of-course portfolios supported the rubric scores overall. Recommendations for re-examining the measures and the TPACK framework itself are discussed.

[1]  J. Pellegrino,et al.  Professional Development in Integrating Technology Into Teaching and Learning: Knowns, Unknowns, and Ways to Pursue Better Questions and Answers , 2007 .

[2]  Dean,et al.  What is construct validity , 2009 .

[3]  Jesse Strycker,et al.  Preparation versus practice: How do teacher education programs and practicing teachers align in their use of technology to support teaching and learning? , 2012, Comput. Educ..

[4]  Bosung Kim,et al.  Learning about problem based learning: Student teachers integrating technology, pedagogy and content knowledge , 2009 .

[5]  Charles R. Graham,et al.  Teaching and Measuring TPACK Development in Two Preservice Teacher Preparation Programs , 2009 .

[6]  Mark J. Hofer,et al.  TPACK Development in Teacher Education , 2012 .

[7]  Charles R. Graham,et al.  Diagramming TPACK in Practice: Using an Elaborated Model of the TPACK Framework to Analyze and Depict Teacher Knowledge , 2009, TechTrends.

[8]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[9]  Mary B. Shoffner,et al.  Developing Pedagogical Technology Integration Content Knowledge in Preservice Teachers , 2007 .

[10]  Evrim Baran,et al.  TPACK: AN EMERGING RESEARCH AND DEVELOPMENT TOOL FOR TEACHER EDUCATORS , 2011 .

[11]  Charoula Angeli,et al.  Technological Pedagogical Content Knowledge , 2015 .

[12]  I. Sahin.  DEVELOPMENT OF SURVEY OF TECHNOLOGICAL PEDAGOGICAL AND CONTENT KNOWLEDGE (TPACK) , 2011 .

[13]  Jason T. Abbitt.  Measuring Technological Pedagogical Content Knowledge in Preservice Teacher Education , 2011 .

[14]  D. Lehmann.  An Alternative Procedure for Assessing Convergent and Discriminant Validity , 1988 .

[15]  Yvonna S. Lincoln,et al.  Judging the quality of case study reports , 1990 .

[16]  Douglas D. Agyei,et al.  Using technology pedagogical content knowledge development to enhance learning outcomes , 2012, Education and Information Technologies.

[17]  Charoula Angeli,et al.  Epistemological and methodological issues for the conceptualization, development, and assessment of ICT-TPCK: Advances in technological pedagogical content knowledge (TPCK) , 2009, Comput. Educ..

[18]  J. Glutting,et al.  Examining Domains of Technological Pedagogical Content Knowledge Using Factor Analysis , 2013 .

[19]  Pamela Baxter,et al.  Qualitative Case Study Methodology: Study Design and Implementation for Novice Researchers , 2008 .

[20]  Laura M. Desimone,et al.  Improving Impact Studies of Teachers’ Professional Development: Toward Better Conceptualizations and Measures , 2009 .

[21]  Joshua H. Barnett,et al.  Revisiting technological pedagogical content knowledge: Exploring the TPACK framework , 2010, Comput. Educ..

[22]  Matthew J. Koehler,et al.  A Turn toward Specifying Validity Criteria in the Measurement of Technological Pedagogical Content Knowledge (TPACK) , 2013 .

[23]  L. Krefting.  Rigor in qualitative research: the assessment of trustworthiness. , 1991, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[24]  Funda Dag,et al.  Turkish Adaptation of Technological Pedagogical Content Knowledge Survey for Elementary Teachers. , 2013 .

[25]  Joan E. Hughes,et al.  The Role of Teacher Knowledge and Learning Experiences in Forming Technology-Integrated Pedagogy , 2005 .

[26]  R. Stake.  The art of case study research , 1995 .

[27]  Jack R. Fraenkel,et al.  How to design and evaluate research education / Jack R. Fraenkel, Norman E. Wallen , 1993 .

[28]  Mark J. Hofer,et al.  Testing a TPACK-Based Technology Integration Assessment Rubric , 2010 .

[29]  William M. K. Trochim,et al.  Research methods knowledge base , 2001 .

[30]  Matthew J. Koehler,et al.  Technological Pedagogical Content Knowledge: A Framework for Teacher Knowledge , 2006, Teachers College Record: The Voice of Scholarship in Education.

[31]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[32]  Charles R. Graham.  Theoretical considerations for understanding technological pedagogical content knowledge (TPACK) , 2011, Comput. Educ..

[33]  Ching Sing.  Identifying Science Teachers' Perceptions of Technological Pedagogical and Content Knowledge (TPACK) , 2013 .

[34]  Margaret L. Niess,et al.  Educational Technology, Teacher Knowledge, and Classroom Impact: A Research Handbook on Frameworks and Approaches , 2011 .

[35]  Peggy A. Ertmer,et al.  Goldilocks and TPACK , 2013 .

[36]  Norman E. Wallen,et al.  How to Design and Evaluate Research in Education , 1990 .

[37]  L. Shulman.  Those who Understand: Knowledge Growth in Teaching , 2013 .

[38]  Chin-Chung Tsai,et al.  Exploring the factor structure of the constructs of technological, pedagogical, content knowledge (TPACK) , 2011 .

[39]  Chrystalla Mouza,et al.  Investigating the impact of an integrated approach to the development of preservice teachers' technological pedagogical content knowledge (TPACK) , 2014, Comput. Educ..

[40]  Theodore J. Kopcha,et al.  Self-presentation bias in surveys of teachers’ educational technology practices , 2007 .

[41]  AngeliCharoula,et al.  Epistemological and methodological issues for the conceptualization, development, and assessment of ICT-TPCK , 2009 .

[42]  Melissa Erlene Pierson,et al.  Technology Integration Practice as a Function of Pedagogical Expertise , 2001 .

[43]  Matthew J. Koehler,et al.  How do we measure TPACK? Let me count the ways , 2011 .

[44]  Chin-Chung Tsai,et al.  Examining the technological pedagogical content knowledge of Singapore pre-service teachers with a large-scale survey , 2010, J. Comput. Assist. Learn..

[45]  Robert W. Lucky,et al.  Just right , 1997 .

[46]  D. Whetten.  What Constitutes a Theoretical Contribution , 1989 .

[47]  Matthew J. Koehler,et al.  Technological Pedagogical Content Knowledge (TPACK) , 2009 .