Stochastic switching model for a class of hierarchical unstructured P2P systems

For a class of hierarchical unstructured peer-to-peer(P2P) systems,a Markov switching-space model is introduced to describe their behavior of dynamic grouping.Based on the theory of Markov decision processes,the policy iteration and online policy iteration algorithms for performance optimization are provided.And a simulation example shows the advantage of the proposed method.