Strength Testing in the Air Force: Current Processes and Suggestions for Improvements

Abstract : Since 1987, the Strength Aptitude Test (SAT), a test of physical strength, has been used by the Air Force to screen and classify enlisted personnel to their career specialties. The decision to institute the test was the culmination of several years of research on physical skills testing. However, over the past 20 years, the Air Force has not reevaluated the test as a screening and classification tool. RAND was therefore asked to evaluate the current status of the SAT regarding its usefulness, validity, and fairness for classifying enlisted airmen. This report provides the results of our study. Our evaluation began with an initial review of the SAT, existing evidence regarding its validity, and the current processes for developing cut scores on the SAT. Based on that initial review, we concluded that, while strength testing is needed in the Air Force, the SAT and the current processes for establishing the minimum requirements for entry into certain Air Force specialties (AFSs) may not be ideal. In particular, we identified a number of gaps in the evidence supporting current processes and determined that three research efforts would be worthwhile in helping to close the gaps. This study undertook the first two research efforts; however, as part of our conclusions we provide insight into how the third effort might be conducted.

[1]  F. Schmidt,et al.  The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. , 1998 .

[2]  Teva J. Scheer.  Uniform Guidelines on Employee Selection Procedures , 2007 .

[3]  M. Quiñones,et al.  THE VALIDITY OF ISOMETRIC STRENGTH TESTS , 1994 .

[4]  J. Hogan,et al.  Effects of Preparing for Physical Ability Tests , 1994 .

[5]  Sheldon Zedeck,et al.  Selecting and developing members for the organization , 2011 .

[6]  David W. Robertson,et al.  Documentation of Muscularly Demanding Job Tasks and Validation of an Occupational Strength Test Battery (STB) , 1985 .

[7]  D. Eignor.  The standards for educational and psychological testing. , 2013 .

[8]  Joe W McDaniel,et al.  Weight Lift Capabilities of Air Force Basic Trainees , 1983 .

[9]  A Content Validation Methodology for Job Related Physical Performance Tests , 1989 .

[10]  Peter N. Frykman,et al.  Effects of a Specifically Designed Physical Conditioning Program on the Load Carriage and Lifting Performance of Female Soldiers. , 1997 .

[11]  Edwin A. Fleishman,et al.  Validation of the Military Entrance Physical Strength Capacity Test , 1984 .

[12]  James,et al.  Chapter 5 Physical Test Validation for Job Selection , 2022 .

[13]  James E. Wright,et al.  Performance on Selected Candidate Screening Test Procedures Before and After Army Basic and Advanced Individual Training , 1985 .

[14]  Valarie A. Sheppard,et al.  Performance requirements of physically strenuous occupations: validating minimum standards for muscular strength and endurance , 2004, Ergonomics.

[15]  Ruchi Sinha,et al.  Validation support for selection procedures. , 2011 .

[16]  R. Bryan Kethley,et al.  An analysis of federal court cases involving nine selection devices. , 1999 .

[17]  M P Rayson,et al.  Effects of basic training on material handling ability and physical fitness of British Army recruits. , 1999, Ergonomics.

[18]  M M Ayoub,et al.  Establishing a physical criterion for assigning personnel to U.S. Air Force jobs. , 1987, American Industrial Hygiene Association journal.

[19]  L. E. Gibbons.  Summary of Ergonomics Research for the Crew Chief Model Development , 1989 .

[20]  S. Legg,et al.  The effects of 6 weeks training on the physical fitness of female recruits to the British army. , 1997, Ergonomics.

[21]  Jennifer L. Crafts,et al.  Inductive job analysis: The job/task inventory method. , 1997 .

[22]  J W Hedge,et al.  Personnel selection. , 1997, Annual review of psychology.

[23]  K. Messing,et al.  Women in Procrustean Beds: Strength Testing and the Workplace , 1996 .

[24]  Keith G. Hauret,et al.  Evaluation of Two Army Fitness Programs: The TRADOC Standardized Physical Training Program for Basic Combat Training and the Fitness Assessment Program , 2004 .

[25]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[26]  Joseph J. Knapik,et al.  The Influence of US Army Basic Initial Training on the Muscular Strength of Men and Women , 1980 .

[27]  Bruce H Jones,et al.  The Case for Pre-Enlistment Physical Fitness Testing: Research and Recommendations , 2004 .

[28]  J J Knapik,et al.  The influence of physical fitness training on the manual material handling capability of women. , 1997, Applied ergonomics.

[29]  M. B. Beckett,et al.  Physical Ability-Task Performance Models: Assessing the Risk of Omitted Variable Bias , 2008 .

[30]  D. Truxillo,et al.  Setting Cutoff Scores for Personnel Selection Tests: issues. Illustrations, and Recommendations , 1996 .

[31]  N. Dorans.  Equating Methods and Sampling Designs , 1990 .

[32]  Erich C. Dierdorff,et al.  Work analysis: From technique to theory. , 2011 .

[33]  Gregory J. Cizek,et al.  Setting performance standards : concepts, methods, and perspectives , 2001 .

[34]  M A Sharp,et al.  Progressive resistance training program for improving manual materials handling performance. , 1993, Work.

[35]  N. Henderson,et al.  PREDICTING LONG‐TERM FIREFIGHTER PERFORMANCE FROM COGNITIVE AND PHYSICAL ABILITY MEASURES , 2010 .

[36]  N. Schmitt.  The Oxford Handbook of Personnel Assessment and Selection , 2012 .

[37]  M Rayson,et al.  Development of physical selection procedures for the British Army. Phase 2: Relationship between physical performance tests and criterion tasks , 2000, Ergonomics.

[38]  Michael T. Brannick,et al.  Job and Work Analysis: Methods, Research, and Applications for Human Resource Management , 2019 .