Identifying, Preparing and Evaluating Army Instructors

Abstract : The Army Learning Model (ALM) calls for a re-examination of instructor selection and training. Because the ALM is learner-centric, it specifies that instructors must now become facilitators in a more distributed classroom role. As facilitators, they must acquire skills at tailoring instruction to learners personal characteristics and at employing technology-enabled learning tools. Although the ALM outlines the end-state of the re-examination of instructors, it does not directly address the processes by which the Army is to attain the end-state. This report addresses the need to better explicate the processes by which the Army can select, train, and assess instructors in support of the ALM. General instructor selection, preparation, and assessment processes are addressed. From this, an operational definition of an effective Army instructor is derived, as are the KSAOs for instructors. A framework for the Armys utilization of the KSAOs in instructor selection, preparation, and assessment is provided.

[1]  Eduardo Salas,et al.  Making decisions under stress: Implications for individual and team training. , 1998 .

[2]  Peter A. Youngs,et al.  Teacher Characteristics and Student Achievement Gains: A Review , 2003 .

[3]  Annemarie S. Palincsar,et al.  Group processes in the classroom. , 1996 .

[4]  R. Slavin.  Cooperative Learning: Theory, Research and Practice , 1990 .

[5]  Dan Goldhaber,et al.  Can Teacher Quality Be Effectively Assessed , 2004 .

[6]  Steven D. Maurer,et al.  The validity of employment interviews: A comprehensive review and meta-analysis. , 1994 .

[7]  J. McNally.  Self-Directed Learning, A Guide for Learners and Teachers , 1976 .

[8]  Traci Sitzmann.  A META-ANALYTIC EXAMINATION OF THE INSTRUCTIONAL EFFECTIVENESS OF COMPUTER-BASED SIMULATION GAMES , 2011 .

[9]  Harold H. Wenglinsky.  The Link Between Teacher Classroom Practices and Student Academic Performance , 2002 .

[10]  L. Goe.  The Link between Teacher Quality and Student Outcomes: A Research Synthesis. , 2007 .

[11]  David W. Johnson,et al.  An Educational Psychology Success Story: Social Interdependence Theory and Cooperative Learning , 2009 .

[12]  Herbert J. Walberg,et al.  The effects of computers on learning , 1992 .

[13]  Mário Rui Gomes,et al.  Modeling reality with simulation games for a cooperative learning , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[14]  L. Darling-Hammond,et al.  Authentic assessment of teaching in context , 2000 .

[15]  Robert W. Glover,et al.  Registered apprenticeship training in the US construction industry , 2005 .

[16]  P. A. Cohen.  Student Ratings of Instruction and Student Achievement: A Meta-analysis of Multisection Validity Studies , 1981 .

[17]  Miranda Olff,et al.  The Most Effective Way of Delivering a Train‐the‐Trainers Program: A Systematic Review , 2012, The Journal of continuing education in the health professions.

[18]  Sae Schatz,et al.  Making Good Instructors Great: USMC Cognitive Readiness and Instructor Professionalization Initiatives , 2012 .

[19]  Eduardo Salas,et al.  Measurement and training of TeamSTEPPS dimensions using the Medical Team Performance Assessment Tool. , 2013, Joint Commission journal on quality and patient safety.

[20]  M. Seligman,et al.  Please Scroll down for Article the Journal of Positive Psychology Positive Predictors of Teacher Effectiveness , 2022 .

[21]  Andrew D. Ho,et al.  The Reliability of Classroom Observations by School Personnel. Research Paper. MET Project. , 2013 .

[22]  Lawrence S. Root.  Faculty evaluation: Reliability of peer assessments of research, teaching, and service , 1987 .

[23]  Courtney A. Bell,et al.  Approaches to Evaluating Teacher Effectiveness: A Research Synthesis. , 2008 .

[24]  D. Brewer,et al.  Does Teacher Certification Matter? High School Teacher Certification Status and Student Achievement , 2000 .

[25]  Jared M. Carman,et al.  BLENDED LEARNING DESIGN: FIVE KEY INGREDIENTS , 2002 .

[26]  David Lester,et al.  The Effects of Situated Learning Through a Community Partnership in a Teacher Preparation Program , 2013 .

[27]  J. Lave.  Cognition in Practice: Outdoors: a social anthropology of cognition in practice , 1988 .

[28]  F. Schmidt,et al.  The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. , 1998 .

[29]  William E. Cashin,et al.  Developing an Effective Faculty Evaluation System , 2012 .

[30]  L. Darling-Hammond,et al.  Teacher Evaluation in the Organizational Context: A Review of the Literature , 1983 .

[31]  Paulien C. Meijer,et al.  How do teachers learn in the workplace? An examination of teacher learning activities , 2009 .

[32]  Jeff Grover,et al.  Problem-Based Learning: Instructor Characteristics, Competencies, and Professional Development , 2011 .

[33]  Traci Sitzmann,et al.  A meta-analysis of self-regulated learning in work-related training and educational attainment: what we know and where we need to go. , 2011, Psychological bulletin.

[34]  Heather C. Hill,et al.  Instructional Policy and Classroom Performance: The Mathematics Reform in California , 2000, Teachers College Record: The Voice of Scholarship in Education.

[35]  Robert L. Johnson,et al.  Using Portfolios in Program Evaluation: An Investigation of Interrater Reliability , 2000 .

[36]  M. Segers,et al.  Effects of problem-based learning: a meta- analysis , 2003 .

[37]  Heather Leary,et al.  A Problem Based Learning Meta Analysis: Differences across Problem Types, Implementation Types, Disciplines, and Assessment Levels. , 2009 .

[38]  M. Grace,et al.  Evaluating the training. , 2001, British dental journal.

[39]  D. Garrison,et al.  Critical thinking, cognitive presence, and computer conferencing in distance education , 2001 .

[40]  G. Kasper.  Four perspectives on L2 pragmatic development , 2001 .

[41]  Charles R. White,et al.  Handgun Marksmanship Training: Evaluation of an Advanced Marksmanship Trainer , 2008 .

[42]  Ming Ming Chiu,et al.  Scaffolding of small groups’ metacognitive activities with an avatar , 2011, Int. J. Comput. Support. Collab. Learn..

[43]  David W. Johnson,et al.  Learning Together and Alone. Cooperative, Competitive, and Individualistic Learning. Fourth Edition. , 1991 .

[44]  Georgette M. Michko,et al.  A Meta-Analysis of the Effectiveness of Teaching and Learning With Technology on Student Outcomes December 2003 , 2003 .

[45]  Hua Bai.  Students’ use of Self-regulatory Tool and Critical Inquiry in Online Discussions , 2012 .

[46]  R. K. Wade,et al.  WHAT MAKES A DIFFERENCE IN INSERVICE TEACHER EDUCATION: A META-ANALYSIS OF THE RESEARCH , 1984 .

[47]  Silvia Wen-Yu Lee,et al.  Reviewing the evidence on how teacher professional development affects student achievement , 2007 .

[48]  Ling-Na Kong,et al.  The effectiveness of problem-based learning on development of nursing students' critical thinking: a systematic review and meta-analysis. , 2014, International journal of nursing studies.

[49]  Heidi Keller-Glaze,et al.  A Practical Decision Guide for Integrating Digital Applications and Handheld Devices into Advanced Individual Training , 2013 .

[50]  S. Loeb,et al.  Teacher Preparation and Student Achievement , 2008 .

[51]  Carlin Dowling,et al.  Do hybrid flexible delivery teaching methods improve accounting students' learning outcomes? , 2003 .

[52]  T. Carpenter,et al.  Identifying and Validating a Model of Interpersonal Performance Dimensions , 2004 .

[53]  Olusola O. Adesope,et al.  Intelligent tutoring systems and learning outcomes: A meta-analysis , 2014 .

[54]  M. James,et al.  Assessment and Learning: differences and relationships between formative and summative assessment , 1997 .

[55]  Helen F. Ladd,et al.  How and Why Do Teacher Credentials Matter for Student Achievement? , 2007 .

[56]  Margaret K. Koenigs,et al.  Teachers and Student Achievement in the Chicago Public High Schools , 2003 .

[57]  J. Deke,et al.  An Evaluation of Teachers Trained through Different Routes to Certification. Final Report. NCEE 2009-4043. , 2009 .

[58]  D. Dunn,et al.  Experiential Learning , 2019, High Impact Teaching for Sport and Exercise Psychology Educators.

[59]  Hyeoun-Ae Park,et al.  A Meta-Analysis on the Effectiveness of Computer-Based Education in Nursing , 2010, Healthcare informatics research.

[60]  K. Feldman.  The significance of circumstances for college students' ratings of their teachers and courses , 1979 .

[61]  Effects of Situated Learning on Knowledge Gain of Instructional Strategies by Students in a Graduate Level Course , 2006 .

[62]  William E. Cashin.  Student Ratings of Teaching: The Research Revisited. IDEA Paper No. 32. , 1995 .

[63]  Steve Benson.  The Relative Merits of PBL (Problem-Based Learning) in University Education , 2012 .

[64]  Thomas J. Kane,et al.  National Board Certification and Teacher Effectiveness: Evidence from a Random Assignment Experiment , 2008 .

[65]  B. Painter.  Using Teaching Portfolios. , 2001 .

[66]  Rowena Harper,et al.  Individual consultations: Towards a 360-degree evaluation process , 2012 .

[67]  J. D'agostino,et al.  Predicting Teacher Performance With Test Scores and Grade Point Average: A Meta-Analysis , 2009 .

[68]  Sue Betka,et al.  National Center for Education Evaluation and Regional Assistance , 2015 .

[69]  Julian R. Betts,et al.  Determinants of Student Achievement: New Evidence from San Diego , 2003 .

[70]  Konstantin P. Cigularov,et al.  Assessment Centers: Current Practices in the United States , 2009 .

[71]  F. Morgeson,et al.  The Structured Employment Interview: Narrative and Quantitative Review of the Research Literature , 2014 .

[72]  Michael E. Martinez.  What is Metacognition? , 2006 .

[73]  Thomas W. H. Ng,et al.  HOW BROADLY DOES EDUCATION CONTRIBUTE TO JOB PERFORMANCE , 2009 .

[74]  D. Reed,et al.  An Effectiveness Assessment and Cost-Benefit Analysis of Registered Apprenticeship in 10 States , 2012 .

[75]  Joseph E. Morsh,et al.  Identifying the Effective Instructor: A Review of the Quantitative Studies. 1900-1952. , 1954 .

[76]  James O. Carey,et al.  The systematic design of instruction , 1978 .

[77]  Kenneth A. Feldman,et al.  Instructional effectiveness of college teachers as judged by teachers themselves, current and former students, colleagues, administrators, and external (neutral) observers , 1989 .

[78]  Philip L. Roth,et al.  A META‐ANALYSIS OF WORK SAMPLE TEST VALIDITY: UPDATING AND INTEGRATING SOME CLASSIC LITERATURE , 2005 .

[79]  Thomas M. Smith,et al.  What Are the Effects of Induction and Mentoring on Beginning Teacher Turnover , 2004 .

[80]  Kenneth A. Feldman,et al.  Consistency and variability among college students in rating their teachers and courses: A review and analysis , 1977 .

[81]  Jean L. Dyer,et al.  Bridging the Gap Between Adaptive Training Research and Army Practice , 2012 .

[82]  Manuela Heinz.  Tomorrow’s teachers—selecting the best: An exploration of the quality rationale behind academic and experiential selection criteria for initial teacher education programmes , 2013 .

[83]  Christopher R. Gareis,et al.  The Efficacy of Portfolios for Teacher Evaluation and Professional Development: Do They Make a Difference? , 2003 .

[84]  C. Henderson,et al.  Faculty perspectives about instructor and institutional assessments of teaching effectiveness , 2012 .

[85]  Ivan T. Robertson,et al.  Work Sample Testing , 2000 .

[86]  D. Schalock.  Research on teacher selection , 1979 .

[87]  Donna L. Sundre.  Assessing faculty work: Enhancing individual and institutional performance , 1995 .

[88]  Eduardo Salas,et al.  Guided Team Self-Correction , 2008 .

[89]  G. Glass.  Teacher Quality and Student Achievement: A Review of State Policy Evidence , 2000 .

[90]  Syed Haque,et al.  A meta-analysis of the training effectiveness of virtual reality surgical simulators , 2006, IEEE Transactions on Information Technology in Biomedicine.

[91]  Joann Bangs.  Experiential Learning In An Organizational Leadership Program , 2011 .

[92]  Cassandra M. Guarino,et al.  Teacher Recruitment and Retention: A Review of the Recent Empirical Literature , 2006 .

[93]  Michael A. Campion,et al.  The situational interview. , 1980 .

[94]  R. Dawes,et al.  Belief in the unstructured interview: The persistence of an illusion , 2013, Judgment and Decision Making.

[95]  Ann L. Brown.  Learning, remembering, and understanding , 1982 .

[96]  E. Hanushek,et al.  Teachers, Schools, and Academic Achievement , 1998 .

[97]  Gina Saliba,et al.  Blended learning , 2010, BDJ.

[98]  Tim R. Sass,et al.  Teacher Training, Teacher Quality, and Student Achievement. Working Paper 3. , 2007 .

[99]  Michael B. Paulsen,et al.  Evaluating Teaching Performance , 2002 .

[100]  Prathibha Varkey,et al.  The effectiveness of self‐directed learning in health professions education: a systematic review , 2010, Medical education.

[101]  Michael D Dlubac,et al.  Comparison of Direct Instruction and Problem Centered Instruction for Army Institutional Training , 2013 .

[102]  W. Damon.  Peer education: The untapped potential , 1984 .

[103]  Jane M. Smyth,et al.  Collaborative digital learning in schools: teacher perceptions of purpose and effectiveness , 2010 .

[104]  Ray Jones,et al.  Using Blended Learning to Improve Student Success Rates in Learning to Program , 2003 .

[105]  M. Gooden.  What Does Racism Have to Do with Leadership? Countering the Idea of Color-Blind Leadership: A Reflection on Race and the Growing Pressures of the Urban Principalship. , 2012 .

[106]  Michelle F. Wright,et al.  Computer Gaming and Interactive Simulations for Learning: A Meta-Analysis , 2006 .

[107]  Kenneth A. Feldman,et al.  The association between student ratings of specific instructional dimensions and student achievement: Refining and extending the synthesis of data from multisection validity studies , 1989 .

[108]  David Moore,et al.  Towards a multidimensional competency‐based managerial performance framework: A hybrid approach , 2005 .

[109]  L. Darling-Hammond,et al.  Effective Teacher Selection: From Recruitment to Retention , 1987 .

[110]  George C. Thornton,et al.  Validity of assessment centers for personnel selection , 2009 .

[111]  F. Worrell,et al.  The Use of Student Ratings of Teacher Behaviors With Academically Talented High School Students , 2001 .

[112]  Bruce C. Leibrecht,et al.  Instructor's Peer-to-Peer Learning Guide for the Army Reconnaissance Course , 2010 .

[113]  Doo Hun Lim,et al.  Strategic Blending: A Conceptual Framework to Improve Learning and Performance , 2007 .

[114]  H. Alix Gallagher,et al.  Vaughn Elementary's Innovative Teacher Evaluation System: Are Teacher Evaluation Scores Related to Growth in Student Achievement? , 2004 .

[115]  Chee-Kit Looi,et al.  Collaborative activities enabled by GroupScribbles (GS): An exploratory study of learning effectiveness , 2010, Comput. Educ..

[116]  S. Simmons.  Reflective faculty evaluation: Enhancing teaching and determining faculty effectiveness , 1996 .

[117]  Jennifer I. Berne,et al.  Chapter 6 : Teacher Learning and the Acquisition of Professional Knowledge: An Examination of Research on Contemporary Professlonal Development , 1999 .

[118]  T. Sass,et al.  Teacher training, teacher quality and student achievement , 2011 .

[119]  B. Gimbert,et al.  Predicting Teacher Success Using Teacher Selection Practices and Classroom Performance Assessment , 2009 .

[120]  Maha ALSaiady,et al.  Peer Observation of Teaching , 2016 .

[121]  Donovan A. McFarlane,et al.  Evaluating Training Programs: The Four Levels , 2006 .

[122]  Raymond L. Pecheone,et al.  Gathering Feedback for Teaching Combining High-Quality Observations with Student Surveys and Achievement Gains , 2012 .

[123]  L. S. Vygotksy.  Mind in society: the development of higher psychological processes , 1978 .

[124]  L. Kyriakides.  Drawing from Teacher Effectiveness Research and Research into Teacher Interpersonal Behaviour to Establish a Teacher Evaluation System: A Study on the Use of Student Ratings to Evaluate Teacher Behaviour. , 2005 .

[125]  Naomi J. Aldrich,et al.  Does Discovery-Based Instruction Enhance Learning?. , 2011 .

[126]  J. Flavell.  Metacognition and Cognitive Monitoring: A New Area of Cognitive-Developmental Inquiry. , 1979 .

[127]  Ronald L. Vansickle.  A Quantitative Review of Research on Instructional Simulation Gaming: A Twenty-Year Perspective , 1986 .

[128]  Eduardo Salas,et al.  Requirements for Future Research in Flight Simulation Training: Guidance Based on a Meta-Analytic Review , 1992 .

[129]  Geoffrey D. Borman,et al.  Examining the Relationship Between Teacher Evaluation and Student Assessment Results in Washoe County , 2004 .

[130]  Linda Darling-Hammond,et al.  Does Teacher Preparation Matter? Evidence about Teacher Certification, Teach for America, and Teacher Effectiveness , 2005 .

[131]  W. J. Webster.  Selecting Effective Teachers , 1988 .

[132]  Catherine Cone,et al.  Instructional Scaffolding to Improve Students’ Skills in Evaluating Clinical Literature , 2011, American Journal of Pharmaceutical Education.

[133]  Peter Seldin,et al.  Evaluating faculty performance : a practical guide to assessing teaching, research, and service , 2006 .

[134]  S. Metzger,et al.  Commercial Teacher Selection Instruments: The Validity of Selecting Teachers Through Beliefs, Attitudes, and Values , 2008 .

[135]  Validation of Student, Principal, and Self-Ratings in 360° Feedback® for Teacher Evaluation , 2000 .

[136]  J. Kolodner,et al.  Toward implementing distributed scaffolding: Helping students learn science from design , 2005 .

[137]  S. Glazerman,et al.  An Evaluation of the Chicago Teacher Advancement Program (Chicago TAP) after Four Years. Final Report. , 2012 .

[138]  C. Hmelo‐Silver.  Problem-Based Learning: What and How Do Students Learn? , 2004 .

[139]  Howard K Wachtel,et al.  Student Evaluation of College Teaching Effectiveness: a brief review , 1998 .

[140]  L. Darling-Hammond,et al.  Developing and assessing beginning teacher effectiveness: the potential of performance assessments , 2013 .

[141]  C. Brandt,et al.  Examining District Guidance to Schools on Teacher Evaluation Policies in the Midwest Region. Issues & Answers. REL 2007-No. 030. , 2007 .

[142]  Scott A. Beal,et al.  Exploring the Use of a Multiplayer Game to Execute Light Infantry Company Missions , 2009 .

[143]  D. Kirkpatrick.  Techniques for evaluating training programs , 1979 .

[144]  Norma Mertz.  Teacher Selection and School Leader Effects , 2010 .

[145]  Thomas A Louis,et al.  Jump down to Document , 2022 .

[146]  Z. Kablan,et al.  The Effectiveness Level of Material Use in Classroom Instruction: A Meta-Analysis Study , 2013 .

[147]  Deborah W. Hamby,et al.  Meta-Analysis of the Effectiveness of Four Adult Learning Methods and Strategies , 2010 .

[148]  Provost,et al.  Teacher intelligence : What is it and why do we care ? , 2012 .

[149]  Dylan Wiliam,et al.  Formative Assessment: Getting the Focus Right , 2006 .

[150]  Corey Seemiller,et al.  The Student Leadership Competencies Guidebook: Designing Intentional Leadership Learning and Development , 2013 .

[151]  T. Nielsen.  Implementation of learning styles at the teacher level , 2008 .

[152]  Thomas J. Kane,et al.  Ensuring Fair and Reliable Measures of Effective Teaching Culminating Findings from the MET Project ’ s Three-Year Study , 2013 .

[153]  Winston Bennett,et al.  Effectiveness of training in organizations: a meta-analysis of design and evaluation features. , 2003, The Journal of applied psychology.