  Two major bottlenecks to the solution of large-scale Bayesian inverse
problems are the scaling of posterior sampling algorithms to high-dimensional
parameter spaces and the computational cost of forward model evaluations. Yet
incomplete or noisy data, the state variation and parameter dependence of the
forward model, and correlations in the prior collectively provide useful
structure that can be exploited for dimension reduction in this setting--both
in the parameter space of the inverse problem and in the state space of the
forward model. To this end, we show how to jointly construct low-dimensional
subspaces of the parameter space and the state space in order to accelerate the
Bayesian solution of the inverse problem. As a byproduct of state dimension
reduction, we also show how to identify low-dimensional subspaces of the data
in problems with high-dimensional observations. These subspaces enable
approximation of the posterior as a product of two factors: (i) a projection of
the posterior onto a low-dimensional parameter subspace, wherein the original
likelihood is replaced by an approximation involving a reduced model; and (ii)
the marginal prior distribution on the high-dimensional complement of the
parameter subspace. We present and compare several strategies for constructing
these subspaces using only a limited number of forward and adjoint model
simulations. The resulting posterior approximations can rapidly be
characterized using standard sampling techniques, e.g., Markov chain Monte
Carlo. Two numerical examples demonstrate the accuracy and efficiency of our
approach: inversion of an integral equation in atmospheric remote sensing,
where the data dimension is very high; and the inference of a heterogeneous
transmissivity field in a groundwater system, which involves a partial
differential equation forward model with high dimensional state and parameters.
