  The detection of terrestrial planets by radial velocity and photometry is
hindered by the presence of stellar signals. Those are often modeled as
stationary Gaussian processes, whose kernels are based on qualitative
considerations, which do not fully leverage the existing physical understanding
of stars. Our aim is to build a formalism which allows to transfer the
knowledge of stellar activity into practical data analysis methods. In
particular, we aim at obtaining kernels with physical parameters. This has two
purposes: better modelling signals of stellar origin to find smaller
exoplanets, and extracting information about the star from the statistical
properties of the data. We consider several observational channels such as
photometry, radial velocity, activity indicators, and build a model called
FENRIR to represent their stochastic variations due to stellar surface
inhomogeneities. We compute analytically the covariance of this multi-channel
stochastic process, and implement it in the S+LEAF framework to reduce the cost
of likelihood evaluations from $O(N^3)$ to $O(N)$. We also compute analytically
higher order cumulants of our FENRIR model, which quantify its non-Gaussianity.
We obtain a fast Gaussian process framework with physical parameters, which we
apply to the HARPS-N and SORCE observations of the Sun, and constrain a solar
inclination compatible with the viewing geometry. We then discuss the
application of our formalism to granulation. We exhibit non-Gaussianity in
solar HARPS radial velocities, and argue that information is lost when stellar
activity signals are assumed to be Gaussian. We finally discuss the origin of
phase shifts between RVs and indicators, and how to build relevant activity
indicators. We provide an open-source implementation of the FENRIR Gaussian
process model with a Python interface.
