Airline Passenger Profiling Based on Fuzzy Deep Machine Learning

Passenger profiling plays a vital part of commercial aviation security, but classical methods become very inefficient in handling the rapidly increasing amounts of electronic records. This paper proposes a deep learning approach to passenger profiling. The center of our approach is a Pythagorean fuzzy deep Boltzmann machine (PFDBM), whose parameters are expressed by Pythagorean fuzzy numbers such that each neuron can learn how a feature affects the production of the correct output from both the positive and negative sides. We propose a hybrid algorithm combining a gradient-based method and an evolutionary algorithm for training the PFDBM. Based on the novel learning model, we develop a deep neural network (DNN) for classifying normal passengers and potential attackers, and further develop an integrated DNN for identifying group attackers whose individual features are insufficient to reveal the abnormality. Experiments on data sets from Air China show that our approach provides much higher learning ability and classification accuracy than existing profilers. It is expected that the fuzzy deep learning approach can be adapted for a variety of complex pattern analysis tasks.

[1]  Andrew R. Webb,et al.  Statistical Pattern Recognition: Webb/Statistical Pattern Recognition , 2011 .

[2]  Krassimir T. Atanassov,et al.  Intuitionistic fuzzy sets , 1986 .

[3]  Sheldon Howard Jacobson,et al.  A multilevel passenger screening problem for aviation security , 2006 .

[4]  Huseyin Cavusoglu,et al.  An Analysis of the Impact of Passenger Profiling for Transportation Security , 2010, Oper. Res..

[5]  Ronald R. Yager,et al.  Pythagorean fuzzy subsets , 2013, 2013 Joint IFSA World Congress and NAFIPS Annual Meeting (IFSA/NAFIPS).

[6]  Chin-Hui Lee,et al.  Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains , 1994, IEEE Trans. Speech Audio Process..

[7]  Huseyin Cavusoglu,et al.  Economics of User Segmentation, Profiling, and Detection in Security , 2006 .

[8]  Yu-Jun Zheng,et al.  Population Classification in Fire Evacuation: A Multiobjective Particle Swarm Optimization Approach , 2014, IEEE Transactions on Evolutionary Computation.

[9]  Iddo Greental,et al.  Genetic algorithms for evolving deep neural networks , 2014, GECCO.

[10]  Yongdong Zhang,et al.  A Highly Parallel Framework for HEVC Coding Unit Partitioning Tree Decision on Many-core Processors , 2014, IEEE Signal Processing Letters.

[11]  Shinji Watanabe,et al.  Structure discovery of deep neural network based on evolutionary algorithms , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Xin Yao,et al.  A review of evolutionary artificial neural networks , 1993, Int. J. Intell. Syst..

[13]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[14]  Gin-Der Wu,et al.  A TS-Type Maximizing-Discriminability-Based Recurrent Fuzzy Network for Classification Problems , 2011, IEEE Transactions on Fuzzy Systems.

[15]  C. L. Philip Chen,et al.  Fuzzy Restricted Boltzmann Machine for the Enhancement of Deep Learning , 2015, IEEE Transactions on Fuzzy Systems.

[16]  Minqiang Li,et al.  Learning Subspace-Based RBFNN Using Coevolutionary Algorithm for Complex Classification Tasks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[17]  João Paulo Papa,et al.  Fine-tuning Deep Belief Networks using Harmony Search , 2016, Appl. Soft Comput..

[18]  Haibo He,et al.  Incremental Learning From Stream Data , 2011, IEEE Transactions on Neural Networks.

[19]  Ling Shao,et al.  Learning Deep and Wide: A Spectral Method for Learning Deep Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Chin-Teng Lin,et al.  Identification and Prediction of Dynamic Systems Using an Interactively Recurrent Self-Evolving Fuzzy Neural Network , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Wei Li,et al.  Single and Multiple Object Tracking Using a Multi-Feature Joint Sparse Representation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Sergio Koc-Menard,et al.  Trends in Terrorist Detection Systems , 2009 .

[23]  Sunita Sarawagi,et al.  Discriminative Methods for Multi-labeled Classification , 2004, PAKDD.

[24]  Seetha Hari,et al.  Learning From Imbalanced Data , 2019, Advances in Computer and Electrical Engineering.

[25]  Zhihua Xia,et al.  A Secure and Dynamic Multi-Keyword Ranked Search Scheme over Encrypted Cloud Data , 2016, IEEE Transactions on Parallel and Distributed Systems.

[26]  Xingming Sun,et al.  Structural Minimax Probability Machine , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Yu-Jun Zheng,et al.  Localized biogeography-based optimization , 2014, Soft Comput..

[28]  Franco Scarselli,et al.  On the Complexity of Neural Network Classifiers: A Comparison Between Shallow and Deep Architectures , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Timothy M. Ravich Airline Passenger Profiling Systems After 9/11: Personal Privacy versus National Security , 2010 .

[30]  Michael Hadjimichael,et al.  A fuzzy expert system for aviation risk assessment , 2009, Expert Syst. Appl..

[31]  Dan Simon,et al.  Biogeography-Based Optimization , 2022 .

[32]  Zeshui Xu,et al.  Pythagorean fuzzy TODIM approach to multi-criteria decision making , 2016, Appl. Soft Comput..

[33]  Huseyin Cavusoglu,et al.  Passenger Profiling and Screening for Aviation Security in the Presence of Strategic Attackers , 2013, Decis. Anal..

[34]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[35]  Timothy Peace Who becomes a terrorist, and why? , 2016 .

[36]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[37]  Yujun Zheng Water wave optimization: A new nature-inspired metaheuristic , 2015, Comput. Oper. Res..

[38]  Sheldon H. Jacobson,et al.  Risk-Based Policies for Airport Security Checkpoint Screening , 2010, Transp. Sci..

[39]  Geoffrey E. Hinton,et al.  Deep Boltzmann Machines , 2009, AISTATS.

[40]  A EsminAhmed,et al.  A review on particle swarm optimization algorithm and its variants to clustering high-dimensional data , 2015 .

[41]  Bart Kosko Counting with Fuzzy Sets , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Arnold Barnett,et al.  CAPPS II: The Foundation of Aviation Security? , 2004, Risk analysis : an official publication of the Society for Risk Analysis.

[43]  Yujun Zheng,et al.  Rescue Wings: Mobile Computing and Active Services Support for Disaster Rescue , 2016, IEEE Transactions on Services Computing.

[44]  Hisao Ishibuchi,et al.  Fuzzy neural networks with fuzzy weights and fuzzy biases , 1993, IEEE International Conference on Neural Networks.

[45]  Jeffrey Rosen The Silver Bullet: Protecting Privacy and Security through Law and Technology , 2007 .

[46]  Li Lin,et al.  Passenger grouping under constant threat probability in an airport security system , 2006, Eur. J. Oper. Res..

[47]  Zeshui Xu,et al.  Extension of TOPSIS to Multiple Criteria Decision Making with Pythagorean Fuzzy Sets , 2014, Int. J. Intell. Syst..

[48]  Yongdong Zhang,et al.  Efficient Parallel Framework for HEVC Motion Estimation on Many-Core Processors , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[49]  Erich Peter Klement,et al.  Fuzzy probability measures , 1981 .

[50]  Hisao Ishibuchi,et al.  Learning by fuzzified neural networks , 1995, Int. J. Approx. Reason..

[51]  Bin Gu,et al.  A Robust Regularization Path Algorithm for $\nu $ -Support Vector Classification , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[52]  Yongdong Zhang,et al.  Parallel deblocking filter for HEVC on many-core processor , 2014 .

[53]  Shengyong Chen,et al.  Acceleration Strategies in Generalized Belief Propagation , 2012, IEEE Transactions on Industrial Informatics.

[54]  Yi Shang,et al.  EvoAE -- A New Evolutionary Method for Training Autoencoders for Deep Learning Networks , 2015, 2015 IEEE 39th Annual Computer Software and Applications Conference.

[55]  Ling Shao,et al.  A rapid learning algorithm for vehicle classification , 2015, Inf. Sci..

[56]  Yu-Jun Zheng,et al.  A Hybrid Neuro-Fuzzy Network Based on Differential Biogeography-Based Optimization for Online Population Classification in Earthquakes , 2015, IEEE Transactions on Fuzzy Systems.

[57]  James T. Luxhoj,et al.  A Hybrid Fuzzy-Belief Network (HFBN) for Modelling Aviation Safety Risk Factors , 2006 .

[58]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[59]  Heather E Reser AIRLINE TERRORISM: THE EFFECT OF TIGHTENED SECURITY ON THE RIGHT TO TRAVEL. , 1998 .

[60]  Sébastien Marcel,et al.  Comparison of MLP and GMM Classifiers for Face Verification on XM2VTS , 2003, AVBPA.

[61]  Ronald R. Yager,et al.  Pythagorean Membership Grades in Multicriteria Decision Making , 2014, IEEE Transactions on Fuzzy Systems.

[62]  Charles F. Manski Profiling: Introduction to the Feature , 2006 .

[63]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[64]  Aaron Strauss,et al.  Carnival Booth: An Algorithm for Defeating the Computer-Assisted Passenger Screening System , 2002, First Monday.

[65]  Yu-Jun Zheng,et al.  Ecogeography-based optimization: Enhancing biogeography-based optimization with ecogeographic barriers and differentiations , 2014, Comput. Oper. Res..

[66]  Jun Zhuang,et al.  Balancing congestion and security in the presence of strategic applicants with private information , 2011, Eur. J. Oper. Res..

[67]  André Stuhlsatz,et al.  Feature Extraction With Deep Neural Networks by a Generalized Discriminant Analysis , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[68]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[69]  Stan Matwin,et al.  A review on particle swarm optimization algorithm and its variants to clustering high-dimensional data , 2013, Artificial Intelligence Review.

[70]  Ronald R. Yager,et al.  Decision making with fuzzy probability assessments , 1999, IEEE Trans. Fuzzy Syst..

[71]  Julie L Virta,et al.  Analyzing the cost of screening selectee and non-selectee baggage. , 2003, Risk analysis : an official publication of the Society for Risk Analysis.

[72]  Jacek Skorupski,et al.  Fuzzy inference system for the efficiency assessment of hold baggage security control at the airport , 2015 .