Use of Multitrait-Multimethod Modelling to Validate Actual and Preferred Forms of the Technology-Rich Outcomes-Focused Learning Environment Inventory (TROFLEI).

This paper describes the validation of actual and preferred forms of a new classroom environment instrument - the Technology-Rich Outcomes-Focused Learning Environment Inventory (TROFLEI) - using multitrait-multimethod modelling. The 80-item TROFLEI assesses 10 classroom environment dimensions: Student Cohesiveness, Teacher Support, Involvement, Investigation, Task Orientation, Cooperation, Equity, Differentiation, Computer Usage and Young Adult Ethos. A sample of 1,249 high school students from Western Australia and Tasmania responded to actual and preferred forms of the TROFLEI. Separate exploratory factor analyses for the actual and preferred forms supported the 10 scale a priori structure of the instrument. The use of multitrait-multimethod modelling with the 10 scales as traits and the two forms of the instrument as methods supported the TROFLEI's construct validity. The results of this research provide strong evidence of the sound psychometric properties of this new learning environment instrument.

[1]  Chester A. Schriesheim,et al.  The Effect of Negation and Polar Opposite Item Reversals on Questionnaire Reliability and Validity: An Experimental Investigation , 1991 .

[2]  E. Kelloway.  Using LISREL for Structural Equation Modeling: A Researcher′s Guide , 1998 .

[3]  D. Cole,et al.  Validation of depression and anxiety measures in white and black youths : Multitrait-multimethod analyses , 1998 .

[4]  E. Glasersfeld.  Cognition, construction of knowledge, and teaching , 1989, Synthese.

[5]  Darrell L. Fisher,et al.  Technology-Rich Learning Environments: A Future Perspective , 2003 .

[6]  David F. Treagust,et al.  Validity and Use of a Classroom Environment Instrument for Higher Education. , 1986 .

[7]  MEASURING CULTURALLY SENSITIVE FACTORS OF CLASSROOM LEARNING ENVIRONMENTS WITH THE CLEQ , 2002 .

[8]  Darrell L. Fisher,et al.  Monitoring constructivist classroom learning environments , 1997 .

[9]  Chester A. Schriesheim,et al.  Controlling Acquiescence Response Bias by Item Reversals: The Effect on Questionnaire Validity , 1981 .

[10]  B. Byrne,et al.  Confirmatory Factor Analysis of Multitrait-Multimethod Self-concept Data: Between-group and Within-group Invariance Constraints. , 1993, Multivariate behavioral research.

[11]  Gregory P. Thomas,et al.  Conceptualisation, Development and Validation of an Instrument for Investigating the Metacognitive Orientation of Science Classroom Learning Environments: The Metacognitive Orientation Learning Environment Scale – Science (MOLES-S) , 2003 .

[12]  Jeffrey P. Dorman,et al.  Associations Between Classroom Environment and Academic Efficacy , 2001 .

[13]  Richard G. Lomax,et al.  A Beginner's Guide to Structural Equation Modeling , 2022 .

[14]  B. Fraser,et al.  Evolution and Validation of a Personal Form of an Instrument for Assessing Science Laboratory Classroom Environments. , 1995 .

[15]  L. R. Goldberg,et al.  Comparative validity of different strategies of constructing personality inventory scales. , 1967, Psychological bulletin.

[16]  Barry J. Fraser,et al.  Classroom Environment Instruments: Development, Validity and Applications , 1998 .

[17]  Kenneth Tobin,et al.  The Practice of constructivism in science education , 1993 .

[18]  Mimi Bong,et al.  Measuring Self-Efficacy: Multitrait-Multimethod Comparison of Scaling Procedures , 2001 .

[19]  Darrell L. Fisher,et al.  Classroom Environment and Teacher Interpersonal Behaviour in Secondary Science Classes in Korea , 2000 .

[20]  K. Widaman.  Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data , 1985 .

[21]  L. Dumenci,et al.  Multitrait-multimethod Analysis , 2000 .

[22]  J. Bruner.  Actual minds, possible worlds , 1985 .

[23]  Jeffrey P. Dorman,et al.  Cross-National Validation of the What is Happening in this Class? (WIHIC) Questionnaire using Confirmatory Factor Analysis , 2003 .

[24]  Jack Levy,et al.  Do You Know What You Look Like?: Interpersonal Relationships In Education , 1993 .

[25]  Bruce J. Biddle,et al.  The Study of Teaching , 1974 .

[26]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[27]  Campbell J. McRobbie,et al.  Science Laboratory Classroom Environments at Schools and Universities: A Cross‐National Study∗ , 1995 .

[28]  Gerald J. Pine,et al.  Fostering psychosocial development in the classroom , 1988 .

[29]  M. Browne,et al.  The decomposition of multitrait-multimethod matrices. , 1984, The British journal of mathematical and statistical psychology.

[30]  F. Adolphe.  A cross-national study of classroom environment and attitudes among junior secondary science students in Australia and in Indonesia , 2002 .

[31]  B. Byrne,et al.  Modeling MTMM Data from Additive and Multiplicative Covariance Structures: An Audit of Construct Validity Concordance. , 1993, Multivariate behavioral research.

[32]  D. Allen.  Parent and student perceptions of the science learning environment and its influence on student outcomes , 2003 .

[33]  Jill M. Aldridge,et al.  Constructivist learning environments in a crossnational study in Taiwan and Australia , 2000 .

[34]  Barry J. Fraser,et al.  Investigating the Learning Environment in Canadian Mathematics and Science Classrooms in Which Laptop Computers Are Used , 2002 .

[35]  J. Jackson Barnette,et al.  Effects of Stem and Likert Response Option Reversals on Survey Internal Consistency: If You Feel the Need, There is a Better Alternative to Using those Negatively Worded Stems , 2000 .

[36]  Barry J. Fraser,et al.  Predictive Validity of an Individualised Classroom Environment Questionnaire. , 1981 .

[37]  Elazar J. Pedhazur,et al.  Measurement, Design, and Analysis: An Integrated Approach , 1994 .

[38]  Karl G. Jöreskog,et al.  Lisrel 8: User's Reference Guide , 1997 .

[39]  B. Byrne,et al.  Investigating the Measurement of Social and Academic Competencies for Early/Late Preadolescents and Adolescents: A Multitrait-Multimethod Analysis. , 1996 .

[40]  Jill M. Aldridge,et al.  A Cross-cultural Study of Classroom Learning Environments in Australia and Taiwan , 2000 .

[41]  B. Byrne.  Structural Equation Modeling with LISREL, PRELIS, and SIMPLIS: Basic Concepts, Applications, and Programming , 1998 .

[42]  B. Fraser.  Science Learning Environments: Assessment, Effects and Determinants , 1998 .

[43]  Myint Swe Khine,et al.  Studies In Educational Learning Environments: An International Perspective , 2002 .