  We study the problem of multi-agent coordination in unpredictable and
partially observable environments, that is, environments whose future evolution
is unknown a priori and that can only be partially observed. We are motivated
by the future of autonomy that involves multiple robots coordinating actions in
dynamic, unstructured, and partially observable environments to complete
complex tasks such as target tracking, environmental mapping, and area
monitoring. Such tasks are often modeled as submodular maximization
coordination problems due to the information overlap among the robots. We
introduce the first submodular coordination algorithm with bandit feedback and
bounded tracking regret -- bandit feedback is the robots' ability to compute in
hindsight only the effect of their chosen actions, instead of all the
alternative actions that they could have chosen instead, due to the partial
observability; and tracking regret is the algorithm's suboptimality with
respect to the optimal time-varying actions that fully know the future a
priori. The bound gracefully degrades with the environments' capacity to change
adversarially, quantifying how often the robots should re-select actions to
learn to coordinate as if they fully knew the future a priori. The algorithm
generalizes the seminal Sequential Greedy algorithm by Fisher et al. to the
bandit setting, by leveraging submodularity and algorithms for the problem of
tracking the best action. We validate our algorithm in simulated scenarios of
multi-target tracking.
