  Score-based stochastic denoising models have recently been demonstrated as
powerful machine learning tools for conditional and unconditional image
generation. The existing methods are based on a forward stochastic process
wherein the training images are scaled to zero over time and white noise is
gradually added such that the final time step is approximately zero-mean
identity-covariance Gaussian noise. A neural network is then trained to
approximate the time-dependent score function, or the gradient of the logarithm
of the probability density, for that time step. Using this score estimator, it
is possible to run an approximation of the time-reversed stochastic process to
sample new images from the training data distribution. These score-based
generative models have been shown to out-perform generative adversarial neural
networks using standard benchmarks and metrics. However, one issue with this
approach is that it requires a large number of forward passes of the neural
network. Additionally, the images at intermediate time steps are not useful,
since the signal-to-noise ratio is low. In this work we present a new method
called Fourier Diffusion Models which replaces the scalar operations of the
forward process with shift-invariant convolutions and the additive white noise
with additive stationary noise. This allows for control of MTF and NPS at
intermediate time steps. Additionally, the forward process can be crafted to
converge to the same MTF and NPS as the measured images. This way, we can model
continuous probability flow from true images to measurements. In this way, the
sample time can be used to control the tradeoffs between measurement
uncertainty and generative uncertainty of posterior estimates. We compare
Fourier diffusion models to existing scalar diffusion models and show that they
achieve a higher level of performance and allow for a smaller number of time
steps.
