  Many multi-agent systems have the structure of a single coordinator providing
behavioral or financial incentives to a large number of agents. Two challenges
faced by the coordinator are a finite budget from which to allocate incentives,
and an initial lack of knowledge about the utility function of the agents.
Here, we present a behavioral analytics approach to solve the coordinator's
problem when agents make decisions by maximizing utility functions that depend
on prior system states, inputs, and other parameters that are initially unknown
and subject to temporal dynamics. Our behavioral analytics framework involves
three steps: first, we develop a behavioral model that describes the
decision-making process of an agent; second, we use data to estimate behavioral
model parameters for each agent and then use these estimates to predict future
decisions of each agent; and third, we use the estimated behavioral model
parameters to optimize a set of costly incentives to provide to each agent. In
this paper, we describe a specific set of tools, models, and approaches that
fit into this framework, and that adapt models and incentives as new
information is collected by repeating the second and third steps of this
framework. Furthermore, we prove that incentives computed by this adaptive
approach are asymptotically optimal with respect to a given loss function that
describes the coordinator's objective. We optimize incentives using a
decomposition scheme, where each sub-problem solves the coordinator's problem
for a single agent, and the master problem is a pure integer program. We
conclude with a simulation study to evaluate the effectiveness of our
behavioral analytics approach in designing personalized treatment plans for a
weight loss program. The results show our approach maintains efficacy of the
program while reducing costs by up to 60%, while adaptive heuristics provide
less savings.
