Architecture and capabilities of a data warehouse for ATM research

This paper describes the design, implementation, and use of a data warehouse that supports air traffic management (ATM) research at NASA's Ames Research Center. The data warehouse, dubbed Sherlock, has been in development since 2009 and is a crucial piece of the ATM research infrastructure used by Ames and its partners. Sherlock comprises several components, including a database, a Web-based user interface, and supplementary services for query and visualization. The information stored includes raw data collected from the National Airspace System (NAS), parsed and processed data, derived data, and reports derived from pre-defined queries. The raw data include a variety of flight information from live streams of FAA operational systems, weather observations and forecasts, and NAS advisories and statistics. The modified data comprise parsed and merged data sources and metadata, enabling parameterized searches for data of interest. The derived data represent the results of research analyses deemed to be of significant interest to a wide cross-section of users. Sherlock is implemented on an Oracle 11g database, with supplemental services built on open-source packages and custom software. It contains over 20 TB of data spanning several years, and more data are added daily. It has supported several research studies, such as finding similar days in the NAS and predicting imposition of traffic flow management restrictions. Planned enhancements include integrated search across data sources and the capability for large-scale analytics.

[1]  Jeffery A. Schroeder.  A Perspective on NASA Ames Air Traffic Management Research , 2009 .

[2]  Ralph Kimball,et al.  The Data Warehouse Toolkit: The Complete Guide to Dimensional Modeling , 1996 .

[3]  Viktor Mayer-Schnberger,et al.  Big Data: A Revolution That Will Transform How We Live, Work, and Think , 2013 .

[4]  David McNally,et al.  Operational Evaluatioin of Dynamic Weather Routes at American Airlines , 2013 .

[5]  Eric Gossett,et al.  Big Data: A Revolution That Will Transform How We Live, Work, and Think , 2015 .

[6]  Man-Cheung Max Lui.  Complete Decoding and Reporting of Aviation Routine Weather Reports (METARs) , 2014 .

[7]  Jeff Browder,et al.  Performance Data Analysis Reporting System (PDARS) : a valuable addition to FAA managers' toolsets , 2011 .

[8]  J. Evans,et al.  THE CORRIDOR INTEGRA TED WEATHER SYSTEM (CIWS) , 2002 .

[9]  Alexander A. Anisimov.  Review of The data warehouse toolkit: the complete guide to dimensional modeling (2nd edition) by Ralph Kimball, Margy Ross. John Wiley & Sons, Inc. 2002. , 2003, SGMD.

[10]  Banavar Sridhar,et al.  Similar Days in the NAS: an Airport Perspective , 2013 .

[11]  Banavar Sridhar,et al.  Classification and Computation of Aggregate Delay Using Center-based Weather Impacted Traffic Index , 2007 .

[12]  Natalya F. Noy,et al.  Semantic integration: a survey of ontology-based approaches , 2004, SGMD.

[13]  Banavar Sridhar,et al.  Clustering Days with Similar Airport Weather Conditions , 2014 .

[14]  R. DeLaura,et al.  An Exploratory Study of Modeling Enroute Pilot Convective Storm Flight Deviation Behavior , 2005 .

[15]  Michael Bloem,et al.  Ground Delay Program Analytics with Behavioral Cloning and Inverse Reinforcement Learning , 2014, J. Aerosp. Inf. Syst..

[16]  Banavar Sridhar,et al.  Classification of Days Using Weather Impacted Traffic in the National Airspace System , 2013 .

[17]  Harry N. Swenson,et al.  Design and Operational Evaluation of the Traffic Management Advisor at the Ft. Worth Air Route Traffic Control Center , 1997 .

[18]  Edward I. Powers,et al.  An Evaluation of the High Level Architecture (HLA) as a Framework for NASA Modeling and Simulation , 2000 .