  Data-driven predictions are often perceived as inaccurate in hindsight due to
behavioral responses. We consider the role of interface design choices on how
individuals respond to predictions presented on a shared information display in
a strategic setting. We introduce a novel staged experimental design to
investigate the effects of interface design features, such as the visualization
of prediction uncertainty and prediction error, within a repeated congestion
game. In this game, participants assume the role of taxi drivers and use a
shared information display to decide where to search for their next ride. Our
experimental design endows agents with varying level-$k$ depths of thinking,
allowing some agents to possess greater sophistication in anticipating the
decisions of others using the same information display. Through several large
pre-registered experiments, we identify trade-offs between displays that are
optimal for individual decisions and those that best serve the collective
social welfare of the system. Additionally, we note that the influence of
display characteristics varies based on an agent's strategic sophistication. We
observe that design choices promoting individual-level decision-making can lead
to suboptimal system outcomes, as manifested by a lower realization of
potential social welfare. However, this decline in social welfare is offset by
a slight reduction in distribution shift, narrowing the gap between predicted
and realized system outcomes. This may enhance the perceived reliability and
trustworthiness of the information display post hoc. Our findings pave the way
for new research questions concerning the design of effective prediction
interfaces in strategic environments.
