ASTAR Operational Evaluation Final Report Volume II: Study Reports

An operational study evaluating the utility of ASTAR (Automated Simulator Test and Assessment RoutinE'.) and AIMS (Automated Instructional Media Selection) was conducted with the assistance of subject matter experts (SMEs) from the Marine Corps Reserve located in Tallahassee, Florida, and training analyst!? and SMEs from the Naval Training Systems Center, PM TRADE, and Computer Sciences Corporation located in Orlando, Florida. The subj ects were asked to use and evaluate ASTAR and AIMS and to compare them to any existing methodologies with which they were aware. The specific weapon system to which the decision aids were appl ied was the Marine Corps M60AI main battle tank. The training devices compared in the study were the MCTFIST M60Al cre",' trainer and the GUARD FIST I MIA I crew trainer. A combination of questionnaires, self-initiated logs, and actual results derived from the use of the two trainer evaluation techniques was used to gather data for the study. The findings indicated that while the concept for the techniques was believed to be sound and both aids were perceived to have benefits, both methodologies had definite shortcomings that should be corrected if ~Jide acceptability is to be achieved. Specific suggestions for changes to the programs that would improve user acceptance were elicited during the course of the study.

[1]  Lois Littleton.  THE PILOT TRAINING STUDY: A USER'S GUIDE TO THE PILOT COMPUTER MODEL , 1969 .

[2]  Richard K Matlick,et al.  A Review of Models for Cost and Training Effectiveness Analysis (CTEA) , 1985 .

[3]  Marshall B. Jones,et al.  Empirical Demonstration of Isoperformance Methodology Preparatory of an Interactive Expert Computerized Decision Aid , 1988 .

[4]  Wayne W Zachary.  Cost Benefit Assessment of Candidate Decision Aids for Naval Air ASW. , 1981 .

[5]  Joseph String,et al.  Operating Costs of Aircraft and Flight Simulators , 1984 .

[6]  H. D. Kribs,et al.  An Evaluation of Media Selection. , 1982 .

[7]  R. A. Kisner,et al.  Method for analytical evaluation of computer-based decision aids , 1984 .

[8]  John Billings.  User's Manual for Training Device Cost Model 'TRACOM'. , 1983 .

[9]  Gino L Liberati,et al.  ASSET (Acquisition of Supportable Systems Evaluation Technology) Users Guide: Application. , 1985 .

[10]  Gregory J McCannel.  A Cost Determination Model for the Functional Context Training Revision of Basic Electricity and Electronics Training. , 1985 .

[11]  Richard Braby.  A Technique for Choosing Cost-Effective Instructional Delivery Systems. Final Report. , 1975 .

[12]  James S. Kildebeck,et al.  RATED RESOURCE REQUIREMENTS SYSTEM. A LINEAR PROGRAMMING DETERMINATION OF A LEAST-COST PILOT STRUCTURE FOR A SIMULATED ENVIRONMENT. , 1969 .

[13]  Lois Littleton.  THE PILOT TRAINING STUDY: A USER'S GUIDE TO THE UNDERGRADUATE PILOT TRAINING COMPUTER COST MODEL. , 1969 .

[14]  Henry C. Okraski,et al.  Staff Study on Cost and Training Effectiveness of Proposed Training Systems. , 1972 .

[15]  Richard K Matlick,et al.  Cost and Training Effectiveness Analysis (CTEA) Performance Guide. , 1980 .

[16]  S. L. Allison.  The Pilot Training Study: A Cost-Estimating Model for Undergraduate Pilot Training. , 1969 .

[17]  Robert K. Branson,et al.  The Interservice Procedures for Instructional Systems Development. , 1978 .

[18]  Peter Geissler,et al.  Military Occupational Speciality Training Cost Handbook (MOSB) , 1983 .

[19]  James R Skeen,et al.  Life Cycle Training Costs: A Literature Review. , 1981 .

[20]  Marilee N. Connelly.  A PERSONNEL COST DATA BANK FOR USE IN STUDIES OF COST AND EFFECTIVENESS , 1967 .

[21]  Jerrold M Levine,et al.  Instructional Materials: Life Cycle Cost Analysis for Human Factors, Manpower Personnel and Training Issues in Military System Development , 1984 .

[22]  Angelo Mirabella,et al.  Comparison-Based Prediction of Cost and Effectiveness of Training Devices: A Guidebook , 1985 .

[23]  James E Brown,et al.  A Life-Cycle Cost Model for an Electronic Maintenance Trainer. , 1982 .

[24]  D. M. Kelly,et al.  Cost and Training Effectiveness Analysis for Stand-Off Target Acquisition Surveillance System. , 1977 .

[25]  David S. Vaughan,et al.  Research and Development of the Training Decisions System , 1989 .

[26]  Milton C Ross,et al.  A Parametric Costing Model for Flight Simulator Acquisition. , 1976 .

[27]  Walter F Thode,et al.  Establishing Relative Costs in a Complex Training System: A Cost Assessment Model and Its Application in the P-3 Fleet Readiness Squadron Aircrew Training System. , 1982 .

[28]  L. E. Knollmeyer.  THE PILOT TRAINING STUDY: A COST ESTIMATING MODEL FOR ADVANCED PILOT TRAINING (APT) , 1969 .

[29]  John Daniel. Obal.  A Methodology for Determining Training Event Cost. , 1983 .

[30]  M. F. Levine.  COPI " Navy Personnel Research and Development Center , 2022 .

[31]  John F. Patterson,et al.  Training Requirements and Cost Evaluation System (TRACES) for Marine Air Command and Control. Phase II. , 1982 .

[32]  Richard K Matlick,et al.  Cost and Training Effectiveness Analysis in the Army Life Cycle Systems Management Model , 1980 .

[33]  Mark G. Pfeiffer,et al.  Experimental and Analytic Evaluation of the Effects of Visual and Motion Simulation in SH-3 Helicopter Training. Technical Report 85-002. , 1985 .

[34]  Clarence A Semple.  Simulator Training Requirements and Effectiveness Study (STRES): Executive Summary. , 1981 .

[35]  Walter G. Hartung.  USE OF COMPUTERIZED COST MODELS IN COST ANALYSIS , 1969 .

[36]  Joseph String,et al.  Cost-Effectiveness of Flight Simulators for Military Training. Volume 2. Estimating Costs of Training in Simulators and Aircraft , 1977 .

[37]  Ann E. Barron,et al.  User's Analysis And Evaluation Of Two Computer-based Training System Design Aids: OSBATS And ASTAR , 1989 .

[38]  Jesse Orlansky,et al.  Macro-Level Training Data: A Conceptual Model Relating Training Cost and Effectiveness Data to Training Policy Interests and Issues , 1988 .

[39]  Barry H. Kantowitz,et al.  Experimental Psychology: Understanding Psychological Research , 1978 .

[40]  Ruth A Wienclaw,et al.  A Model for Determining Cost and Training Effectiveness Tradeoffs for Training Equipment , 1982 .

[41]  A E Jackson,et al.  Life Cycle Training Cost Model. , 1981 .