Perceptions and Efficacy of Flight Operational Quality Assurance (FOQA) Programs Among Small-scale Operators

Despite safety and economic advantages, as well as endorsements by the International Civil Aviation Organization, the FAA, the National Transportation Safety Board, and Congress, voluntary Flight Operational Quality Assurance (FOQA) participation has not been fully implemented in the United States (GAO, 2010), particularly among small operators. Pilots’ concern about data misuse continues to be one of the primary factors preventing participation in voluntary safety programs. Considered in conjunction with pilots’ attitudes and pressure from pilot unions, airlines might find it difficult to justify the cost of implementing and maintaining a FOQA program if they are dubious about its benefits or concerned about its risks. Increased FOQA participation among small-scale air carriers may depend on demonstrating that significant safety benefits can be gained and positive perceptions of the program sustained, with minimal cost to the operator. The current study evaluates both attitudinal and operational aspects of a FOQA program maintained by a small-scale government aircraft operator. The Perceptions of Flight Operations Quality Assurance (PFOQA) questionnaire was used to systematically collect information about pilots’ attitudes regarding FOQA. Questionnaire items were based on concerns and recommendations proposed by the Flight Safety Foundation FOQA task force created to identify issues that might hinder or prevent the implementation of FOQA. Survey participants were a sample of 83 government pilots drawn from a population of approximately 180 Office of Aviation System Standards (AJW) pilots. A time series analysis of FOQA event rates was used to determine whether quarterly reports providing feedback to pilots (a cost-effective intervention method) can produce significant safety benefits. FOQA exceedances used in the time series analyses were de-identified monthly summary data for the Learjet 60 fleet recorded between July 2006 and November 2010. The overlap between the distributions of the Positive and Negative Perceptions scales of the PFOQA suggests that the pilot group demonstrated a certain amount of ambivalence toward FOQA, recognizing both the value and risks of the program. The results of the time series analyses indicated that feedback provided to pilots in quarterly reports produced significant reductions in exceedance rates. A trend in the time series data was the pervasive reduction in these exceedances over the course of the program. This was encouraging for the AJW operation and should motivate other small operators to pursue FOQA.

[1]  Bruno D. Zumbo,et al.  Is the selection of statistical methods governed by level of measurement , 1993 .

[2]  Bandman El Protection of human subjects. , 1980, JAMA.

[3]  D. R. Johnson,et al.  Ordinal measures in multiple indicator models: A simulation study of categorization error. , 1983 .

[4]  Sylvia G. Roch,et al.  A Social Exchange Model of Employee Reactions to Electronic Performance Monitoring , 2009 .

[5]  Carol A Manning,et al.  A Human Factors Review of the Operational Error Literature , 2006 .

[6]  A. Westin,et al.  Two key factors that belong in a macroergonomic analysis of electronic monitoring: Employee perceptions of fairness and the climate of organizational trust or distrust. , 1992, Applied ergonomics.

[7]  R. Sitgreaves Psychometric theory (2nd ed.). , 1979 .

[8]  J. R. Aiello,et al.  The role of participation and control in the effects of computer monitoring on fairness perceptions, task satisfaction, and performance. , 2001, The Journal of applied psychology.

[9]  John H Enders STUDY URGES APPLICATION OF FLIGHT OPERATIONAL QUALITY ASSURANCE METHODS IN U.S. AIR CARRIER OPERATIONS. , 1993 .

[10]  William D. Berry Understanding regression assumptions , 1993 .

[11]  B. Tabachnick,et al.  Using multivariate statistics, 5th ed. , 2007 .

[12]  Elaine M. Pfleiderer,et al.  Establishing the Reliability and Validity of the Perceptions of Flight Operations Quality Assurance (PFOQA) Questionnaire , 2011 .

[13]  Graham K. Rand,et al.  Quantitative Applications in the Social Sciences , 1983 .

[14]  M. Konovsky,et al.  Perceived fairness of employee drug testing as a predictor of employee attitudes and job performance. , 1991, The Journal of applied psychology.