  We introduce a physics-driven deep latent variable model (PDDLVM) to learn
simultaneously parameter-to-solution (forward) and solution-to-parameter
(inverse) maps of parametric partial differential equations (PDEs). Our
formulation leverages conventional PDE discretization techniques, deep neural
networks, probabilistic modelling, and variational inference to assemble a
fully probabilistic coherent framework. In the posited probabilistic model,
both the forward and inverse maps are approximated as Gaussian distributions
with a mean and covariance parameterized by deep neural networks. The PDE
residual is assumed to be an observed random vector of value zero, hence we
model it as a random vector with a zero mean and a user-prescribed covariance.
The model is trained by maximizing the probability, that is the evidence or
marginal likelihood, of observing a residual of zero by maximizing the evidence
lower bound (ELBO). Consequently, the proposed methodology does not require any
independent PDE solves and is physics-informed at training time, allowing the
real-time solution of PDE forward and inverse problems after training. The
proposed framework can be easily extended to seamlessly integrate observed data
to solve inverse problems and to build generative models. We demonstrate the
efficiency and robustness of our method on finite element discretized
parametric PDE problems such as linear and nonlinear Poisson problems, elastic
shells with complex 3D geometries, and time-dependent nonlinear and
inhomogeneous PDEs using a physics-informed neural network (PINN)
discretization. We achieve up to three orders of magnitude speed-up after
training compared to traditional finite element method (FEM), while outputting
coherent uncertainty estimates.
