Evaluating the face and content validity of a Teaching and LearningGuiding Principles Instrument (TLGPI): a perspective study ofMalaysian teacher educators

Teaching and Learning Guiding Principles (TLGP) describes an organization’s beliefs and philosophy pertaining to quality assurance and performance improvement which guides the ‘what’, ‘why’ and ‘how’ of its activities. It is also a statement on the scholarship of teaching and learning and a reference guide to good practice specifically for teacher education institutions. The purpose of this study was to evaluate the face and content validity of a Teaching and Learning Guiding Principles Instrument (TLGPI). An expert panel of nine academicians in the field of teacher education reviewed and rated the TLGPI for the relevance and representativeness of each item based on a dichotomous rating of favourable or unfavourable. Their ratings were used to seek an agreement between the two or more raters in Cohen’s Kappa Index (CKI) and also to calculate the Content Validity Index (CVI) values of each final item. The percentage inter-rater agreement yielded at 70% of agreement in CKI. Items with CVI greater than 0.78 were included in the final instrument. The final instrument contained 67 items of 5-point Likert scale multiple choice options, categorised under six thematic domains namely (1) intellectual excitement; (2) quality learning spaces; (3) constructive alignment; (4) international and cultural diversity; (5) climate of inquiry and critical reflection; and finally (6) nurture good values, attitude and behaviour. The finding supports the face and content validity of this 67-item questionnaire, hence could be further researched on construct validity.

[1]  D. P. Hartmann,et al.  The Effects of Instructional Prompts and Praise on Children's Donation Rates. , 1975 .

[2]  J. Oluwatayo Validity and Reliability Issues in Educational Research , 2012 .

[3]  W. Popham Modern educational measurement : a practitioner's perspective , 1990 .

[4]  P. Ramsden,et al.  The development, validation and application of the Course Experience Questionnaire , 1997 .

[5]  D. Lynn Kelley Measurement Made Accessible: A Research Approach Using Qualitative, Quantitative and Quality Improvement Methods , 1999 .

[6]  Bruce Levin,et al.  Assessing Significance in a Fourfold Table , 2004 .

[7]  M. Hellman,et al.  Development and Validation of a Questionnaire to Assess the Effect of Online Learning on Behaviors, Attitudes, and Clinical Practices of Physical Therapists in the United States Regarding Evidenced-based Clinical Practice , 2013, Internet Journal of Allied Health Sciences and Practice.

[8]  P. Brennan,et al.  The kappa statistic for establishing interrater reliability in the secondary analysis of qualitative clinical data. , 1992, Research in nursing & health.

[9]  C. Waltz,et al.  Measurement in nursing research , 1984 .

[11]  Cheryl Tatano Beck,et al.  The content validity index: are you sure you know what's being reported? Critique and recommendations. , 2006, Research in nursing & health.

[12]  C. Wynd,et al.  Two Quantitative Approaches for Estimating Content Validity , 2003, Western journal of nursing research.

[13]  R M Kaplan,et al.  Health status: types of validity and the index of well-being. , 1976, Health services research.

[14]  The osteoporosis risk assessment tool: establishing content validity through a panel of experts. , 2002, Applied nursing research : ANR.

[15]  S. Haynes,et al.  Content validity in psychological assessment: A functional approach to concepts and methods. , 1995 .

[16]  M. Lynn Determination and quantification of content validity. , 1986, Nursing research.

[17]  Hoi K. Suen,et al.  Analyzing Quantitative Behavioral Observation Data , 1989 .

[18]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[19]  H. Marsh Students ' Evaluations of University Teaching : Dimensionality , Reliability , Validity , Potential Biases , and Utility , 2005 .

[20]  C. H. Lawshe A QUANTITATIVE APPROACH TO CONTENT VALIDITY , 1975 .

[21]  R. Fox Validating lecturer effectiveness questionnaires in accounting , 1994 .