Learning Air Traffic as Images: A Deep Convolutional Neural Network for Airspace Operation Complexity Evaluation

A sector is a basic unit of airspace whose operation is managed by air traffic controllers. *e operation complexity of a sector plays an important role in air traffic management system, such as airspace reconfiguration, air traffic flowmanagement, and allocation of air traffic controller resources. *erefore, accurate evaluation of the sector operation complexity (SOC) is crucial. Considering there are numerous factors that can influence SOC, researchers have proposed several machine learning methods recently to evaluate SOC by mining the relationship between factors and complexity. However, existing studies rely on hand-crafted factors, which are computationally difficult, specialized background required, and may limit the evaluation performance of the model. To overcome these problems, this paper for the first time proposes an end-to-end SOC learning framework based on deep convolutional neural network (CNN) specifically for free of hand-crafted factors environment. A new data representation, i.e., multichannel traffic scenario image (MTSI), is proposed to represent the overall air traffic scenario. A MTSI is generated by splitting the airspace into a two-dimension grid map and filled with navigation information. Motivated by the applications of deep learning network, the specific CNNmodel is introduced to automatically extract highlevel traffic features fromMTSIs and learn the SOC pattern. *us, the model input is determined by combining multiple image channels composed of air traffic information, which are used to describe the traffic scenario.*emodel output is SOC levels for the target sector.*e experimental results using a real dataset from the Guangzhou airspace sector in China show that our model can effectively extract traffic complexity information fromMTSIs and achieve promising performance than traditionalmachine learningmethods. In practice, ourwork can be flexibly and conveniently applied to SOC evaluation without the additional calculation of hand-crafted factors.

[1]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Parimal Kopardehr DYNAMIC DENSITY : MEASURING AND PREDICTING SECTOR COMPLEXITY , 2004 .

[3]  P. Kopardekar MEASUREMENT AND PREDICTION OF DYNAMIC DENSITY , 2002 .

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Victor Fernando Gómez Comendador,et al.  Impact of Trajectories’ Uncertainty in Existing ATC Complexity Methodologies and Metrics for DAC and FCA SESAR Concepts , 2019, Energies.

[7]  Max Mulder,et al.  SECTOR COMPLEXITY MEASURES: A COMPARISON , 2015 .

[8]  Amy R. Pritchett,et al.  Describing Airspace Complexity: Airspace Response to Disturbances , 2009 .

[9]  Xianbin Cao,et al.  A semi-supervised learning method for air traffic complexity evaluation , 2017, 2017 Integrated Communications, Navigation and Surveillance Conference (ICNS).

[10]  Jun Zhao,et al.  Recurrent Convolutional Neural Networks for Text Classification , 2015, AAAI.

[11]  Daniel Delahaye,et al.  Air traffic complexity based on dynamical systems , 2010, 49th IEEE Conference on Decision and Control (CDC).

[12]  Luigi Piroddi,et al.  Toward Air Traffic Complexity Assessment in New Generation Air Traffic Management Systems , 2011, IEEE Transactions on Intelligent Transportation Systems.

[13]  Yuki Endo,et al.  Classifying spatial trajectories using representation learning , 2016, International Journal of Data Science and Analytics.

[14]  Arnab Majumdar,et al.  Air Traffic Control Complexity and Safety , 2007 .

[15]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Giuseppe Aceto,et al.  Mobile Encrypted Traffic Classification Using Deep Learning: Experimental Evaluation, Lessons Learned, and Challenges , 2019, IEEE Transactions on Network and Service Management.

[17]  Yunlong Zhang,et al.  Safety of Efficiency: Link Between Operational Performance and Operational Errors in the National Airspace System , 2004 .

[18]  Jun Zhang,et al.  ATCEM: a synthetic model for evaluating air traffic complexity , 2016 .

[19]  Xianbin Cao,et al.  Measuring air traffic complexity based on small samples , 2017 .

[20]  Anthony J. Masalonis,et al.  DYNAMIC DENSITY AND COMPLEXITY METRICS FOR REALTIME TRAFFIC FLOW MANAGEMENT , 2003 .

[21]  Pierluigi Salvo Rossi,et al.  Sensor-Fault Detection, Isolation and Accommodation for Digital Twins via Modular Data-Driven Architecture , 2021, IEEE Sensors Journal.

[22]  Hakan Gunduz,et al.  Deep Learning-Based Parkinson’s Disease Classification Using Vocal Feature Sets , 2019, IEEE Access.

[23]  Zhenlong Li,et al.  Measurement of Controller Workloads Based on Air Traffic Complexity Factors , 2012 .

[24]  Dapeng Wu,et al.  A knowledge-transfer-based learning framework for airspace operation complexity evaluation , 2018, Transportation Research Part C: Emerging Technologies.

[25]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[26]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[27]  David Gianazza,et al.  Forecasting workload and airspace configuration with neural networks and tree search methods , 2010, Artif. Intell..

[28]  Christian Wolf,et al.  Sequential Deep Learning for Human Action Recognition , 2011, HBU.

[29]  Banavar Sridhar,et al.  Measures for air traffic controller workload prediction , 2001 .

[30]  Hong Liu,et al.  Research on the Air Traffic Flow Prediction Using a Deep Learning Approach , 2019, IEEE Access.

[31]  S. Puechmorel,et al.  AIR TRAFFIC COMPLEXITY : TOWARDS INTRINSIC METRICS , 2000 .

[32]  Maria Prandini,et al.  A probabilistic measure of air traffic complexity in 3‐D airspace , 2010 .

[33]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.