Routing for Crowd Management in Smart Cities: A Deep Reinforcement Learning Perspective

The concept of smart city has been flourishing based on the prosperous development of various advanced technologies: mobile edge computing (MEC), ultra-dense networking, and software defined networking. However, it becomes increasingly complicated to design routing strategies to meet the stringent and ever changing network requirements due to the dynamic distribution of the crowd in different sectors of smart cities. To alleviate the network congestion and balance the network load for supporting smart city services with dramatic disparities, we design a deep-reinforcement- learning-based smart routing algorithm to make the distributed computing and communication infrastructure thoroughly viable while simultaneously satisfying the latency constraints of service requests from the crowd. Besides the proposed algorithm, extensive numerical results are also presented to validate its efficacy.

[1]  Jaime Llorca,et al.  IoT-Cloud Service Optimization in Next Generation Smart Environments , 2016, IEEE Journal on Selected Areas in Communications.

[2]  Badong Chen,et al.  Efficient and robust deep learning with Correntropy-induced loss function , 2016, Neural Computing and Applications.

[3]  Song Guo,et al.  Green Resource Allocation Based on Deep Reinforcement Learning in Content-Centric IoT , 2018, IEEE Transactions on Emerging Topics in Computing.

[4]  Tao Jin,et al.  Application-awareness in SDN , 2013, SIGCOMM.

[5]  Franca Delmastro,et al.  People-centric computing and communications in smart cities , 2016, IEEE Communications Magazine.

[6]  Jun Li,et al.  A Super Base Station Architecture for Future Ultra-Dense Cellular Networks: Toward Low Latency and High Energy Efficiency , 2018, IEEE Communications Magazine.

[7]  Junyuan Wang,et al.  A Machine Learning Framework for Resource Allocation Assisted by Cloud Computing , 2017, IEEE Network.

[8]  Hossam S. Hassanein,et al.  Monitoring road surface anomalies towards dynamic road mapping for future smart cities , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[9]  Frank Dürr,et al.  High Performance Publish/Subscribe Middleware in Software-Defined Networks , 2017, IEEE/ACM Transactions on Networking.

[10]  Matthew Roughan,et al.  The Internet Topology Zoo , 2011, IEEE Journal on Selected Areas in Communications.

[11]  Sunil Kumar,et al.  Intelligent Software-Defined Mesh Networks With Link-Failure Adaptive Traffic Balancing , 2018, IEEE Transactions on Cognitive Communications and Networking.

[12]  Khaled Ben Letaief,et al.  Dynamic Computation Offloading for Mobile-Edge Computing With Energy Harvesting Devices , 2016, IEEE Journal on Selected Areas in Communications.

[13]  Mahadev Satyanarayanan,et al.  The Impact of Mobile Multimedia Applications on Data Center Consolidation , 2013, 2013 IEEE International Conference on Cloud Engineering (IC2E).