  We consider a class of $N$-player nonsmooth aggregative games over networks
in stochastic regimes, where the $i$th player is characterized by a composite
cost function $f_i+d_i+r_i$, $f_i$ is a smooth expectation-valued function
dependent on its own strategy and an aggregate function of rival strategies,
$d_i$ is a convex hierarchical term dependent on its strategy, and $r_i$ is a
nonsmooth convex function of its strategy with an efficient prox-evaluation. We
design a fully distributed iterative proximal stochastic gradient method
overlaid by a Tikhonov regularization, where each player may independently
choose its steplengths and regularization parameters while meeting some
coordination requirements. Under a monotonicity assumption on the concatenated
player-specific gradient mapping, we prove that the generated sequence
converges almost surely to the least-norm Nash equilibrium. In addition, we
establish the convergence rate associated with the expected gap function at the
time-averaged sequence. Furthermore, we consider the extension to the private
hierarchical regime where each player is a leader with respect to a collection
of private followers competing in a strongly monotone game, parametrized by
leader decisions. By leveraging a convolution-smoothing framework, we present
amongst the first fully distributed schemes for computing a Nash equilibrium of
a game complicated by such a hierarchical structure. Based on this framework,
we extend the rate statements to accommodate the computation of a hierarchical
stochastic Nash equilibrium by using a Fitzpatrick gap function. Notably, both
sets of fully distributed schemes display near-optimal sample-complexities,
suggesting that this hierarchical structure does not lead to performance
degradation. Finally, we validate the proposed methods on a networked
Nash-Cournot equilibrium problem and a hierarchical generalization.
