Applying Big Data, Machine Learning, and SDN/NFV for 5G Early-Stage Traffic Classification and Network QoS Control

Due to the rapid growth of mobile broadband and IoT applications, the early-stage mobile traffic classification becomes more important for traffic engineering to guarantee Quality of Service (QoS), implement resource management, and network security. Therefore, identifying traffic flows based on a few packets during the early state has attracted attention in both academic and industrial fields. However, a powerful and flexible platform to handle millions of traffic flows is still challenging. This study aims to demonstrate how to integrate various state-of-the-art machine learning (ML) algorithms, big data analytics platforms, software-defined networking (SDN), and network functions virtualization (NFV) to build a comprehensive framework for developing future 5G SON applications. This platform successfully collected, stored, analyzed, and identified a huge number of real-time traffic flows at broadband Mobile Lab (BML), National Chiao Tung University (NCTU). Moreover, we also implemented network QoS control to configure priorities per-flow traffic to enable bandwidth guarantees for each application by using SDN. Finally, the performance of the proposed models was evaluated by applying them to a real testbed environment. The powerful computing capacity of the platform was also analyzed.

[1]  Alice Chen,et al.  The design of big data analytics for testing & measurement and traffic flow on an experimental 4G/LTE network , 2015, 2015 24th Wireless and Optical Communication Conference (WOCC).

[2]  Dawei Wang,et al.  Robust Feature Selection for IM Applications at Early Stage Traffic Classification Using Machine Learning Algorithms , 2017, 2017 IEEE 19th International Conference on High Performance Computing and Communications; IEEE 15th International Conference on Smart City; IEEE 3rd International Conference on Data Science and Systems (HPCC/SmartCity/DSS).

[3]  Bao-Shuh Paul Lin,et al.  On the classification of mobile broadband applications , 2016, 2016 IEEE 21st International Workshop on Computer Aided Modelling and Design of Communication Links and Networks (CAMAD).

[4]  Li-Chun Wang,et al.  Deterministic Quality of Service Guarantee for Dynamic Service Chaining in Software Defined Networking , 2017, IEEE Transactions on Network and Service Management.

[5]  Nino Vincenzo Verde,et al.  Analyzing Android Encrypted Network Traffic to Identify User Actions , 2016, IEEE Transactions on Information Forensics and Security.

[6]  Chen Yuehui,et al.  How many packets are most effective for early stage traffic identification: An experimental study , 2014, China Communications.

[7]  Nen-Fu Huang,et al.  Application traffic classification at the early stage by characterizing application rounds , 2013, Inf. Sci..

[8]  Jun Zhang,et al.  Internet Traffic Classification by Aggregating Correlated Naive Bayes Predictions , 2023, IEEE Transactions on Information Forensics and Security.

[9]  Tarik Taleb,et al.  Ensuring End-to-End QoS Based on Multi-Paths Routing Using SDN Technology , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[10]  Riyad Alshammari,et al.  Identification of VoIP encrypted traffic using a machine learning approach , 2015, J. King Saud Univ. Comput. Inf. Sci..

[11]  Yong Wang,et al.  Spark-Based Feature Selection Algorithm of Network Traffic Classification , 2017, 2017 13th International Conference on Computational Intelligence and Security (CIS).

[12]  Béla Hullár,et al.  Efficient Methods for Early Protocol Identification , 2014, IEEE Journal on Selected Areas in Communications.

[13]  Bao-Shuh Paul Lin,et al.  The Design of Cloud-Based 4G/LTE for Mobile Augmented Reality with Smart Mobile Devices , 2013, 2013 IEEE Seventh International Symposium on Service-Oriented System Engineering.

[14]  Bao-Shuh Paul Lin,et al.  Big data and machine learning driven handover management and forecasting , 2017, 2017 IEEE Conference on Standards for Communications and Networking (CSCN).

[15]  Fernando A. Kuipers,et al.  Providing bandwidth guarantees with OpenFlow , 2016, 2016 Symposium on Communications and Vehicular Technologies (SCVT).

[16]  Bao-Shuh Paul Lin,et al.  The Roles of 5G Mobile Broadband in the Development of IoT, Big Data, Cloud and SDN , 2016 .

[17]  Bao-Shuh Paul Lin,et al.  A practical model for traffic forecasting based on big data, machine-learning, and network KPIs , 2018, 2018 15th IEEE Annual Consumer Communications & Networking Conference (CCNC).