Development and validation of the educational technologist multimedia competency survey

The purpose of this research study was to identify the multimedia competencies of an educational technologist by creating a valid and reliable survey instrument to administer to educational technology professionals. The educational technology multimedia competency survey developed through this research is based on a conceptual framework that emphasizes the current definition of the field. Following the conceptual framework, a review of literature and an emergent theme analysis on 205 job announcements in educational technology were conducted. Eighty-five multimedia competencies were derived from this analysis and organized into knowledge, skill, and ability statements. These data were examined using descriptive statistics, internal consistency reliability, exploratory factor analysis, and multivariate analysis of variance. Though the purpose of the instrument was to measure multimedia competencies relevant to the field of educational technology, other constructs on the instrument emerged as more important in the analysis. The results include key competencies, such as knowledge of methods and theories of instruction; soft skills; and the ability to work in a team-oriented environment. A discussion about the results is provided. The instrument was found to have a valid and internally consistent structure.

[1]  W. Arrindell,et al.  Cross-sample invariance of the structure of self-reported distress and difficulty in assertiveness , 1985 .

[2]  Jenny S. Wakefield,et al.  Traits, Skills, & Competencies Aligned with Workplace Demands: What Today's Instructional Designers Need to Master , 2012 .

[3]  W. Velicer,et al.  Relation of sample size to the stability of component patterns. , 1988, Psychological bulletin.

[4]  Abbie Brown,et al.  Identifying Multimedia Production Competencies and Skills of Instructional Design and Technology Professionals: An Analysis of Recent Job Postings , 2012 .

[5]  R. Mayer,et al.  Multimedia Learning: The Promise of Multimedia Learning , 2001 .

[6]  Stephen M. Alessi,et al.  Multimedia for Learning: Methods and Development , 2000 .

[7]  Shahron Williams van Rooij,et al.  Project management in instructional design: ADDIE is not enough , 2010, Br. J. Educ. Technol..

[8]  Rita C. Richey,et al.  Instructional Design Competencies: The Standards , 2001 .

[9]  A. Strauss,et al.  The Discovery of Grounded Theory , 1967 .

[10]  L. Daniels.  Identifying entry-level competencies of Instructional Design and Technology educators and professionals: Results from a biennial survey , 2008 .

[11]  I. E. Allen,et al.  Changing Course: Ten Years of Tracking Online Education in the United States. , 2013 .

[12]  Florence Martin,et al.  Multimedia competencies for an educational technologist: A survey of professionals and job announcement analysis , 2010 .

[13]  Robert A. Reiser,et al.  Trends and issues in instructional design and technology , 2002 .

[14]  Charles M. Reigeluth,et al.  Instructional Design Theories and Models : An Overview of Their Current Status , 1983 .

[15]  Alfred Bork,et al.  Multimedia in Learning , 2001 .

[16]  Joanna C. Dunlap,et al.  An analysis of what instructional designers need to know and be able to do to get a job , 2010 .

[17]  L. Giddings.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, 2d ed , 2005 .

[18]  Kinshuk,et al.  The Education and Training of Learning Technologists: A Competences Approach , 2010, J. Educ. Technol. Soc..

[19]  Richard A. Schwier,et al.  A Review of What Instructional Designers Do: Questions Answered and Questions Not Asked , 2005 .

[20]  Robert Maribe Branch,et al.  Survey of Instructional Design Models , 2022 .

[21]  Abbas Tashakkori,et al.  Mixed Methodology: Combining Qualitative and Quantitative Approaches , 1998 .

[22]  M. Moallem.  Analysis of Job Announcements and the Required Competencies for Instructional Technology Professionals. , 1995 .

[23]  H. Kaiser.  An index of factorial simplicity , 1974 .

[24]  Susan C. Awe.  American Society for Training and Development (ASTD) , 1999 .

[25]  L. Daniels,et al.  Educational Technology professionals in higher education: Multimedia production competencies identified from a Delphi study , 2012 .

[26]  Michael Wilson,et al.  Job Analysis for Human Resource Management: A Review of Selected Research and Development. Manpower Research Monograph No. 36. , 1974 .

[27]  Ning Wang,et al.  Use of Knowledge, Skill, and Ability Statements in Developing Licensure and Certification Examinations , 2005 .

[28]  Engin Kursun,et al.  Current Major Competencies for Instructional Design and Technology Professionals , 2006 .

[29]  James D. Klein,et al.  Improving individual and organizational performance: The case for international standards , 2005 .

[30]  John W. Creswell,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2010 .

[31]  유창조.  Naturalistic Inquiry , 2022, The SAGE Encyclopedia of Research Design.

[32]  Vincent P. Wade,et al.  A survey of soft skill simulation authoring tools , 2008, HT '08.

[33]  Declan Dagger,et al.  Soft Skill Simulation Authoring Tools: A State of the Art Survey , 2008 .

[34]  Manuel Javier Callejo Gallego.  "Mixed methodology. Combining qualitative and quantitative approaches" y "La integración de los métodos cuantitativo y cualitativo en la investigación social. Significado y medida" , 1999 .

[35]  Mary Anne Devanna,et al.  Strategic Human Resource Management , 1984 .

[36]  Robert D. Tennyson,et al.  Defining core competencies of an instructional technologist , 2001, Comput. Hum. Behav..

[37]  J. Michael Spector,et al.  The Education and Training of Learning Technologists: A Competences Approach (Report to IEEE Technical Committee on Learning Technologies) , 2010 .

[38]  J. Nunnally.  Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[39]  M. David Merrill,et al.  The Proper Study of Instructional Design , 2007 .

[40]  A. Januszewski,et al.  Educational Technology : A Definition with Commentary , 2013 .

[41]  H. Coates,et al.  A Critical Examination Of The Effects Of Learning Management Systems On University Teaching And Learning , 2005 .