An Adaptive Deep Q-learning Service Migration Decision Framework for Connected Vehicles

The vehicular service support with adaptability, real-time, and low delay is crucial for connected vehicles. However, due to limited coverage of mobile edge computing servers and data processing capability of connected vehicles, vehicular services need to be offloaded to the edge server and adaptively migrate as the connected vehicle moves. Aiming at the adaptive migration service, a deep Q-learning service migration decision algorithm is proposed in this paper. The proposed algorithm can dynamically adjust the vehicular service migration decision according to traffic information. Furthermore, a service migration framework consisting of neural networks is proposed in this paper to improve the adaptability and real-time performance of the algorithm. By using this framework, training and decision-making can be carried out simultaneously in different places. Finally, compared with the two existing algorithms, extensive simulations are conducted to verify the effectiveness of the proposed algorithm.

[1]  Naixue Xiong,et al.  Connected Vehicle as a Mobile Sensor for Real Time Queue Length at Signalized Intersections , 2019, Sensors.

[2]  Jun Li,et al.  Service Migration in Fog Computing Enabled Cellular Networks to Support Real-Time Vehicular Communications , 2019, IEEE Access.

[3]  Fabio Panzieri,et al.  A survey on handover management in mobility architectures , 2015, Comput. Networks.

[4]  Ning Zhang,et al.  A Survey on Service Migration in Mobile Edge Computing , 2018, IEEE Access.

[5]  Min Sheng,et al.  Mobile-Edge Computing: Partial Computation Offloading Using Dynamic Voltage Scaling , 2016, IEEE Transactions on Communications.

[6]  Tony Q. S. Quek,et al.  Computation Offloading for Mobile Edge Computing Enabled Vehicular Networks , 2019, IEEE Access.

[7]  Pouria Sayyad Khodashenas,et al.  Improved User Experience by Dynamic Service Handover and Deployment on 5G Network Edge , 2019, 2019 21st International Conference on Transparent Optical Networks (ICTON).

[8]  Min Chen,et al.  A Markov Decision Process-based service migration procedure for follow me cloud , 2014, 2014 IEEE International Conference on Communications (ICC).

[9]  Mounir Frikha,et al.  Improved Version of Extended Soft Handover for Real-Time Service in LTE-A System , 2016, 2016 Global Summit on Computer & Information Technology (GSCIT).

[10]  Tarik Taleb,et al.  Follow-Me Cloud: When Cloud Services Follow Mobile Users , 2019, IEEE Transactions on Cloud Computing.

[11]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[12]  Zachary MacHardy,et al.  V2X Access Technologies: Regulation, Research, and Remaining Challenges , 2018, IEEE Communications Surveys & Tutorials.