  Interpreting measurements requires a physical theory, but the theory's
accuracy may vary across the experimental domain. To optimize experimental
design, and so to ensure that the substantial resources necessary for modern
experiments are focused on acquiring the most valuable data, both the theory
uncertainty and the expected pattern of experimental errors must be considered.
We develop a Bayesian approach to this problem, and apply it to the example of
proton Compton scattering. Chiral Effective Field Theory ($\chi$EFT) predicts
the functional form of the scattering amplitude for this reaction, so that the
electromagnetic polarizabilities of the nucleon can be inferred from data. With
increasing photon energy, both experimental rates and sensitivities to
polarizabilities increase, but the accuracy of $\chi$EFT decreases. Our
physics-based model of $\chi$EFT truncation errors is combined with present
knowledge of the polarizabilities and reasonable assumptions about experimental
capabilities at HI$\gamma$S and MAMI to assess the information gain from
measuring specific observables at specific kinematics, \emph{i.e.}, to
determine the relative amount by which new data are apt to shrink
uncertainties. The strongest gains would likely come from new data on the spin
observables $\Sigma_{2x}$ and $\Sigma_{2x^\prime}$ at $\omega\simeq140$ to
$200$ MeV and $40^\circ$ to $120^\circ$. These would tightly constrain
$\gamma_{E1E1}-\gamma_{E1M2}$. New data on the differential cross section
between $100$ and $200$\,MeV and over a wide angle range will substantially
improve constraints on $\alpha_{E1}-\beta_{M1}$, $\gamma_\pi$ and
$\gamma_{M1M1}-\gamma_{M1E2}$. Good signals also exist around $160$ MeV for
$\Sigma_3$ and $\Sigma_{2z^\prime}$. Such data will be pivotal in the
continuing quest to pin down the scalar polarizabilities and refine
understanding of the spin polarizabilities.
