Natural language processing for aviation safety reports: From classification to interactive analysis

HighlightsWe identify the needs for NLP for the analysis of aviation safety reports.Automatic document classification can be performed.Probabilistic topic modelling is of limited use for identifying new aspects.We present an interactive search tool that relies on document similarity.We present another interactive tool that helps experts identify non-technical aspects. In this paper we describe the different NLP techniques designed and used in collaboration between the CLLE-ERSS research laboratory and the CFH/Safety Data company to manage and analyse aviation incident reports. These reports are written every time anything abnormal occurs during a civil air flight. Although most of them relate routine problems, they are a valuable source of information about possible sources of greater danger. These texts are written in plain language, show a wide range of linguistic variation (telegraphic style overcrowded by acronyms or standard prose) and exist in different languages, even for a single company/country (although our main focus is on English and French). In addition to their variety, their sheer quantity (e.g. 600/month for a large airline company) clearly requires the use of advanced NLP and text mining techniques in order to extract useful information from them. Although this context and objectives seem to indicate that standard NLP techniques can be applied in a straightforward manner, innovative techniques are required to handle the specifics of aviation report text and the complex classification systems. We present several tools that aim at a better access to this data (classification and information retrieval), and help aviation safety experts in their analyses (data/text mining and interactive analysis).Some of these tools are currently in test or in use both at the national and international levels, by airline companies as well as by regulation authorities (DGAC,11Direction Generale de l'Aviation Civile. EASA,22European Aviation Safety Agency. ICAO33International Civil Aviation Organization.).