Establishing the Reliability and Validity of the Perceptions of Flight Operations Quality Assurance (PFOQA) Questionnaire

Abstract : Though the majority of Part 121 flights are operated by airlines that have FAA-approved Flight Operations Quality Assurance (FOQA) programs, only 17% of the smaller carriers have them. A recent report cited pilots' concerns about data misuse as one of the primary factors preventing participation in voluntary safety programs (GAO, 2010). Thus, increased participation in FOQA may depend on gaining insight into pilots' perceptions and developing strategies to mitigate their concerns. The present study is an evaluation of the reliability and validity of the Perceptions of Flight Operations Quality Assurance (PFOQA) questionnaire scales. The PFOQA scales were based on the assumption that negative and positive perceptions of FOQA programs represent two distinct dimensions consisting of expectations about positive safety enhancements and concerns about data misuse. Though the Positive Perceptions Scale (=.86) and the Negative Perceptions Scale (=.88) both demonstrated good internal consistency reliability, the results of Principal Components Analysis and Content Analysis suggest that the PFOQA items may not represent a sufficient sample of pilots' expectations and concerns in order to draw valid inferences about their perceptions of existing FOQA programs. Rather, the PFOQA questionnaire seems best suited for assessing pilots' attitudes prior to FOQA implementation. Providing feedback on questionnaire results and communicating how the airline plans to address pilots' concerns can set the stage for a positive program introduction. Certainly, the potential safety benefits of FOQA programs justify efforts to understand and mitigate negative perceptions that might prevent their adoption.