The development and validation of an instrument for assessing college students' perceptions of faculty knowledge in technology-supported class environments

Research in the area of educational technology has argued that the technological pedagogical content knowledge of faculty is crucial to addressing the challenge of teaching in higher education in the digital age, which is characterized by the common use of instructional technology in college classrooms and the ubiquitous presence of computing on college campuses. We developed and validated an instrument for assessing students' perceptions of faculty knowledge (SPFK) in technology-supported classroom environments. A total of 50 items in 4 constructs with 9 items in subject matter knowledge (SMK), 11 items in technological knowledge (TK), 6 items in knowledge of students' understanding (KSU), and 24 items in technological pedagogical content knowledge (TPACK) were developed for the instrument. The construct validity of this instrument was examined through confirmatory factor analysis. After checking the construct structure of the instrument, the multidimensional version of the rating scale model (MRSM) was used to analyze item response data. Results showed that after the elimination of item 17, the 49-item instrument for assessing college students' perceptions of faculty knowledge was validated in the current study. The reliability for each subscale of this instrument was found to be satisfactory when analyzing data with the MRSM model. Discussion of results and recommendations for future research are also provided.

[1]  Wen-Chung Wang,et al.  Modeling Randomness in Judging Rating Scales with a Random‐Effects Rating Scale Model , 2006 .

[2]  B. Wright,et al.  Best test design , 1979 .

[3]  Meghan McGlinn Manfra,et al.  Giving, prompting, making: Framing a conceptual home for TPACK in social studies instruction , 2009 .

[4]  Syh-Jong Jang.  Assessing college students’ perceptions of a case teacher’s pedagogical content knowledge using a newly developed instrument , 2011 .

[5]  H. Waxman,et al.  Investigating Classroom and School Learning Environments: A Review of Recent Research and Developments in the Field. , 1991 .

[6]  Raymond J. Adams,et al.  The Multidimensional Random Coefficients Multinomial Logit Model , 1997 .

[7]  Kent J. Crippen,et al.  Examining TPACK Among K-12 Online Distance Educators in the United States , 2009 .

[8]  Douglas D. Agyei,et al.  Using technology pedagogical content knowledge development to enhance learning outcomes , 2012, Education and Information Technologies.

[9]  Charles R. Graham,et al.  Teaching and Measuring TPACK Development in Two Preservice Teacher Preparation Programs , 2009 .

[10]  R. Hoyle.  Structural equation modeling: concepts, issues, and applications , 1997 .

[11]  T. Hammond,et al.  Giving, Prompting, Making: Aligning Technology and Pedagogy Within TPACK for Social Studies Instruction , 2009 .

[12]  A. W. Bates,et al.  Effective Teaching with Technology in Higher Education: Foundations for Success , 2003 .

[13]  J. H. Steiger.  Structural Model Evaluation and Modification: An Interval Estimation Approach. , 1990, Multivariate behavioral research.

[14]  Matthew J. Koehler,et al.  Technological Pedagogical Content Knowledge (TPACK) , 2009 .

[15]  Syh-Jong Jang,et al.  Developing an instrument for assessing college students’ perceptions of teachers’ pedagogical content knowledge , 2009 .

[16]  Wen-Chung Wang,et al.  Improving measurement precision of test batteries using multidimensional item response models. , 2004, Psychological methods.

[17]  Charles R. Graham,et al.  TPACK Development in Science Teaching: Measuring the TPACK Confidence of Inservice Science Teachers , 2009 .

[18]  Kuan-Chung Chen,et al.  From PCK to TPACK: Developing a Transformative Model for Pre-Service Science Teachers , 2010 .

[19]  H. Waxman.  Urban Black and Hispanic Elementary School Students' Perceptions of Classroom Instruction. , 1989 .

[20]  J. Klassen,et al.  Technology-supported learning: status, issues and trends , 2001, J. Comput. Assist. Learn..

[21]  B. Palmer,et al.  Reshaping Teaching and Learning: The Transformation of Faculty Pedagogical Content Knowledge , 2006 .

[22]  Hilary Hollingsworth,et al.  Elaborating a model of teacher professional growth , 2002 .

[23]  A. Goldberger,et al.  Estimation of a Model with Multiple Indicators and Multiple Causes of a Single Latent Variable , 1975 .

[24]  Peggy A. Ertmer.  Transforming teacher education: Visions and strategies , 2003 .

[25]  David F. Treagust,et al.  The development of an instrument for assessing students' perceptions of teachers' knowledge , 2000 .

[26]  Wen-Chung Wang,et al.  MIMIC Methods for Assessing Differential Item Functioning in Polytomous Items , 2010 .

[27]  Sue Bennett,et al.  Supporting Collaborative Project Teams Using Computer-Based Technologies , 2004 .

[28]  Margaret L. Niess,et al.  Guest Editorial: Preparing Teachers to Teach Mathematics With Technology , 2006 .

[29]  P. Bentler,et al.  Evaluating model fit. , 1995 .

[30]  C. Fox,et al.  Applying the Rasch Model: Fundamental Measurement in the Human Sciences , 2001 .

[31]  Kate Corby.  Whitty, Geoff, Power, Sally, et al. (1998). Devolution and Choice in Education: the School, the State and the Market. Camberwell, Melbourne, Victoria, Australia: Australian Council for Educational Research. , 1998 .

[32]  Aqeel M. Ahmed,et al.  Students thought processes while engaged in computer programming , 1992 .

[33]  D. Andrich.  A rating formulation for ordered response categories , 1978 .

[34]  Margaret L. Niess.  Mathematics Teachers Developing Technology, Pedagogy and Content Knowledge (TPACK) , 2008 .

[35]  Chin-Chung Tsai,et al.  Exploring teachers’ perceived self efficacy and technological pedagogical content knowledge with respect to educational use of the World Wide Web , 2010 .

[36]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[37]  L. Shulman.  Those who Understand: Knowledge Growth in Teaching , 2013 .

[38]  Matthew J. Koehler,et al.  Too Cool for School? No Way! Using the TPACK Framework: You Can Have Your Hot Tools and Teach with Them, Too. , 2009 .

[39]  T. Hicks,et al.  Expanding the Conversation: A Commentary Toward Revision of Swenson, Rozema, Young, McGrail, and Whitin , 2006 .

[40]  Peter Albion,et al.  Auditing the TPACK Confidence of Australian Pre-Service Teachers: The TPACK Confidence Survey (TCS) , 2010 .

[41]  M. Wittrock.  Handbook of research on teaching , 1986 .

[42]  Ransford C. Pyle,et al.  Technology: Servant or Master of the Online Teacher? , 2001, Libr. Trends.

[43]  Matthew J. Koehler,et al.  Technological Pedagogical Content Knowledge: A Framework for Teacher Knowledge , 2006, Teachers College Record: The Voice of Scholarship in Education.

[44]  L. Schrum,et al.  Editorial: Research on the Effectiveness of Technology in Schools: The Roles of Pedagogy and Content , 2007 .

[45]  Charoula Angeli,et al.  Epistemological and methodological issues for the conceptualization, development, and assessment of ICT-TPCK: Advances in technological pedagogical content knowledge (TPCK) , 2009, Comput. Educ..

[46]  Martin Oliver,et al.  Handbook of technological pedagogical content knowledge (TPCK) for educators , 2011 .

[47]  H. Waxman,et al.  Classroom Instruction and Learning Environment Differences between Effective and Ineffective Urban Elementary Schools for African American Students , 1997 .

[48]  P. Bentler,et al.  Fit indices in covariance structure modeling : Sensitivity to underparameterized model misspecification , 1998 .

[49]  Margaret L. Niess,et al.  Preparing teachers to teach science and mathematics with technology: Developing a technology pedagogical content knowledge. , 2005 .

[50]  L. Shulman.  Knowledge and Teaching: Foundations of the New Reform , 1987 .

[51]  Darren George,et al.  SPSS for Windows Step by Step: A Simple Guide and Reference , 1998 .