  In recent years, there has been tremendous progress in the field of semantic
segmentation. However, one remaining challenging problem is that segmentation
models do not generalize to unseen domains. To overcome this problem, one
either has to label lots of data covering the whole variety of domains, which
is often infeasible in practice, or apply unsupervised domain adaptation (UDA),
only requiring labeled source data. In this work, we focus on UDA and
additionally address the case of adapting not only to a single domain, but to a
sequence of target domains. This requires mechanisms preventing the model from
forgetting its previously learned knowledge. To adapt a segmentation model to a
target domain, we follow the idea of utilizing light-weight style transfer to
convert the style of labeled source images into the style of the target domain,
while retaining the source content. To mitigate the distributional shift
between the source and the target domain, the model is fine-tuned on the
transferred source images in a second step. Existing light-weight style
transfer approaches relying on adaptive instance normalization (AdaIN) or
Fourier transformation still lack performance and do not substantially improve
upon common data augmentation, such as color jittering. The reason for this is
that these methods do not focus on region- or class-specific differences, but
mainly capture the most salient style. Therefore, we propose a simple and
light-weight framework that incorporates two class-conditional AdaIN layers. To
extract the class-specific target moments needed for the transfer layers, we
use unfiltered pseudo-labels, which we show to be an effective approximation
compared to real labels. We extensively validate our approach (CACE) on a
synthetic sequence and further propose a challenging sequence consisting of
real domains. CACE outperforms existing methods visually and quantitatively.
