Q-MAP: a novel multicast routing method in wireless ad hoc networks with multiagent reinforcement learning

Multicast plays an important role in ad hoc networks, and multicast algorithms have the goal of directing traffic from sources to receivers maximizing some measure of network performance combining the processes of routing and resource reservation. This paper discusses some current literature about multicast routing in mobile ad hoc networks. Further, by investigating the swarm-based routing method and the multiagent reinforcement learning applications, this paper analyses the possibility and merit of adopting the reinforcement learning method in a multicast routing protocol for wireless ad hoc networks. And based on the above, this paper presents a novel multicast routing method, the Q-MAP algorithm, that ensures the reliability of the resource reservation in the wireless mobile ad hoc networks. The features and efficiency of the Q-MAP multicast routing method are also illustrated in this paper.

[1]  Gang Zhao,et al.  Convergence of the Q-ae learning under deterministic MDPs and its efficiency under the stochastic environment , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[2]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[3]  Marco Dorigo,et al.  AntNet: Distributed Stigmergetic Control for Communications Networks , 1998, J. Artif. Intell. Res..

[4]  Reda Alhajj,et al.  Multiagent reinforcement learning using function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[5]  Jorjeta G. Jetcheva,et al.  Adaptive demand-driven multicast routing in multi-hop wireless ad hoc networks , 2001, MobiHoc '01.

[6]  Craig Boutilier,et al.  The Dynamics of Reinforcement Learning in Cooperative Multiagent Systems , 1998, AAAI/IAAI.

[7]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.