A Reinforcement Learning Approach to Adaptive Forwarding in Named Data Networking

This paper addresses Information Centric Networks, and considers in-network caching for Named Data Networking (NDN) architectures. We depart from forwarding algorithms which primarily use links that have been selected by the routing protocol for probing and forwarding, and propose an adaptive forwarding strategy using reinforcement learning with the random neural network (NDNFS-RLRNN), to leverage the routing information and actively seek possible deliveries outside these paths in a controlled way. Our simulations show that NDNFS-RLRNN achieves more efficient delivery performance than a strategy that strictly follows the routing layer or a strategy that retrieves contents from the nearest caches by flooding requests.

[1]  Alexander Afanasyev,et al.  journal homepage: www.elsevier.com/locate/comcom , 2022 .

[2]  George Pavlou,et al.  Probabilistic in-network caching for information-centric networks , 2012, ICN '12.

[3]  Georgia Sakellari,et al.  The Cognitive Packet Network: A Survey , 2010, Comput. J..

[4]  Patrick Crowley,et al.  Named data networking , 2014, CCRV.

[5]  E. Gelenbe,et al.  Genetic Algorithms for Route Discovery , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Erol Gelenbe,et al.  Adaptive Dispatching of Tasks in the Cloud , 2015, IEEE Transactions on Cloud Computing.

[7]  Erol Gelenbe,et al.  Random Neural Networks with Multiple Classes of Signals , 1999, Neural Computation.

[8]  Matthew Roughan,et al.  The Internet Topology Zoo , 2011, IEEE Journal on Selected Areas in Communications.

[9]  Deep Medhi,et al.  Probability-based adaptive forwarding strategy in named data networking , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[10]  Lixia Zhang,et al.  ndnSIM 2 : An updated NDN simulator for NS-3 , 2016 .

[11]  Masaki Fukushima,et al.  Efficient multipath forwarding and congestion control without route-labeling in CCN , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[12]  Dario Rossi,et al.  INFORM: a dynamic interest forwarding mechanism for information centric networking , 2013, ICN '13.

[13]  Dario Rossi,et al.  Coupling caching and forwarding: benefits, analysis, and implementation , 2014, ICN '14.

[14]  Michael L. Littman,et al.  Packet Routing in Dynamically Changing Networks: A Reinforcement Learning Approach , 1993, NIPS.

[15]  Holger Giese,et al.  Self-aware Computing Systems: Open Challenges and Future Research Directions , 2017, Self-Aware Computing Systems.

[16]  Erol Gelenbe,et al.  Steps toward self-aware networks , 2009, CACM.

[17]  Erol Gelenbe,et al.  Power-aware ad hoc cognitive packet networks , 2004, Ad Hoc Networks.

[18]  George Pavlou,et al.  Cache "less for more" in information-centric networks (extended version) , 2013, Comput. Commun..

[19]  Dmitri V. Krioukov,et al.  An experimental investigation of hyperbolic routing with a smart forwarding plane in NDN , 2016, 2016 IEEE/ACM 24th International Symposium on Quality of Service (IWQoS).

[20]  Cisco Visual Networking Index: Forecast and Methodology 2016-2021.(2017) http://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual- networking-index-vni/complete-white-paper-c11-481360.html. High Efficiency Video Coding (HEVC) Algorithms and Architectures https://jvet.hhi.fraunhofer. , 2017 .

[21]  Alexander Afanasyev,et al.  Adaptive forwarding in named data networking , 2012, CCRV.

[22]  Ugur Halici,et al.  Reinforcement learning with internal expectation for the random neural network , 2000, Eur. J. Oper. Res..

[23]  Erol Gelenbe Self-aware Networks: The Cognitive Packet Network and Its Performance , 2017, Self-Aware Computing Systems.

[24]  J. J. Garcia-Luna-Aceves,et al.  Enabling correct interest forwarding and retransmissions in a content centric network , 2015, 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS).

[25]  Hermann Hellwagner,et al.  SAF: Stochastic Adaptive Forwarding in Named Data Networking , 2015, IEEE/ACM Transactions on Networking.

[26]  Erol Gelenbe,et al.  Cognitive packet networks , 1999, Proceedings 11th International Conference on Tools with Artificial Intelligence.

[27]  Nikos Fotiou,et al.  A Survey of Information-Centric Networking Research , 2014, IEEE Communications Surveys & Tutorials.

[28]  Van Jacobson,et al.  Networking named content , 2009, CoNEXT '09.

[29]  Erol Gelenbe Réseaux neuronaux aléatoires stables , 1990 .