Computation Task Assignment in Vehicular Fog Computing: A Learning Approach via Neighbor Advice

In the recent years, fog computing has been proposed as a promising paradigm to enhance the performance of latency-critical applications by hosting them within idle computation nodes (Fog Nodes, FNs) at the edge of the network. Such a paradigm has been further extended to the vehicular fog computing (VFC) scenario by leveraging available computing resources offered by modern vehicles, thus allowing them to process different types of computation tasks on behalf of onboard users or nearby vehicles. Within this context, the proper assignment of computation tasks to Vehicular FNs is an important issue that is currently under active research. To address this issue, online learning approaches, where the performances of the Vehicular FNs in terms of task execution delay are learnt via trial and error, are starting to gain in popularity. This is mainly motivated by the inherent uncertainty caused by mobility and fluctuating resource availabilities in VFC environments. However, since the process of learning from scratch in such a dynamic vehicular environment may lead to a degradation in the learning performance, this paper proposes the use of an advising mechanism, where a roadside unit (RSU) who has already learnt the performances of the vehicles within its range, uses its acquired knowledge to provide advice to a neighbor RSU who does not have enough experience allowing it to make efficient assignment decisions on its own. To evaluate this approach, we used realistic vehicular mobility traces to simulate the VFC scenario. The obtained results show that our proposed approach improves the learning performance compared to the case where no advice is leveraged.

[1]  Ioannis P. Vlahavas,et al.  Reinforcement learning agents providing advice in complex video games , 2014, Connect. Sci..

[2]  Depeng Jin,et al.  Vehicular Fog Computing: A Viewpoint of Vehicles as the Infrastructures , 2016, IEEE Transactions on Vehicular Technology.

[3]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[4]  Jie Xu,et al.  Task Replication for Vehicular Cloud: Contextual Combinatorial Bandit with Delayed Feedback , 2018, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[5]  Mischa Dohler,et al.  Docitive networks: an emerging paradigm for dynamic spectrum management [Dynamic Spectrum Management] , 2010, IEEE Wireless Communications.

[6]  Frédéric Le Mouël,et al.  On the importance of real data for microscopic urban vehicular mobility trace , 2015, 2015 14th International Conference on ITS Telecommunications (ITST).

[7]  Xuemin Shen,et al.  Reinforcement Learning Based Computation Migration for Vehicular Cloud Computing , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[8]  Yu Xiao,et al.  Fog Following Me: Latency and Quality Balanced Task Allocation in Vehicular Fog Computing , 2018, 2018 15th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[9]  Sunil Kumar,et al.  Apprenticeship Learning Based Spectrum Decision in Multi-Channel Wireless Mesh Networks with Multi-Beam Antennas , 2017, IEEE Transactions on Mobile Computing.

[10]  Felipe Leno da Silva,et al.  Simultaneously Learning and Advising in Multiagent Reinforcement Learning , 2017, AAMAS.

[11]  Raja Lavanya,et al.  Fog Computing and Its Role in the Internet of Things , 2019, Advances in Computer and Electrical Engineering.

[12]  Zhisheng Niu,et al.  Exploiting Moving Intelligence: Delay-Optimized Computation Offloading in Vehicular Fog Networks , 2019, IEEE Communications Magazine.

[13]  Zhisheng Niu,et al.  Task Replication for Vehicular Edge Computing: A Combinatorial Multi-Armed Bandit Based Approach , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[14]  Xin Liu,et al.  Learning-Based Task Offloading for Vehicular Cloud Computing Systems , 2018, 2018 IEEE International Conference on Communications (ICC).

[15]  Jeongho Kwak,et al.  DREAM: Dynamic Resource and Task Allocation for Energy Minimization in Mobile Cloud Systems , 2015, IEEE Journal on Selected Areas in Communications.

[16]  Wei Chu,et al.  A contextual-bandit approach to personalized news article recommendation , 2010, WWW '10.

[17]  J. Bather,et al.  Multi‐Armed Bandit Allocation Indices , 1990 .