A Distributed Iterative Tikhonov Method for Networked Monotone Aggregative Hierarchical Stochastic Games

We consider a class of $N$-player nonsmooth aggregative games over networks in stochastic regimes, where the $i$th player is characterized by a composite cost function $f_i+d_i+r_i$, $f_i$ is a smooth expectation-valued function dependent on its own strategy and an aggregate function of rival strategies, $d_i$ is a convex hierarchical term dependent on its strategy, and $r_i$ is a nonsmooth convex function of its strategy with an efficient prox-evaluation. We design a fully distributed iterative proximal stochastic gradient method overlaid by a Tikhonov regularization, where each player may independently choose its steplengths and regularization parameters while meeting some coordination requirements. Under a monotonicity assumption on the concatenated player-specific gradient mapping, we prove that the generated sequence converges almost surely to the least-norm Nash equilibrium. In addition, we establish the convergence rate associated with the expected gap function at the time-averaged sequence. Furthermore, we consider the extension to the private hierarchical regime where each player is a leader with respect to a collection of private followers competing in a strongly monotone game, parametrized by leader decisions. By leveraging a convolution-smoothing framework, we present amongst the first fully distributed schemes for computing a Nash equilibrium of a game complicated by such a hierarchical structure. Based on this framework, we extend the rate statements to accommodate the computation of a hierarchical stochastic Nash equilibrium by using a Fitzpatrick gap function. Notably, both sets of fully distributed schemes display near-optimal sample-complexities, suggesting that this hierarchical structure does not lead to performance degradation. Finally, we validate the proposed methods on a networked Nash-Cournot equilibrium problem and a hierarchical generalization.