  While summarization has been extensively researched in natural language
processing (NLP), cross-lingual cross-temporal summarization (CLCTS) is a
largely unexplored area that has the potential to improve cross-cultural
accessibility and understanding. This paper comprehensively addresses the CLCTS
task, including dataset creation, modeling, and evaluation. We build the first
CLCTS corpus, leveraging historical fictive texts and Wikipedia summaries in
English and German, and examine the effectiveness of popular transformer
end-to-end models with different intermediate finetuning tasks. Additionally,
we explore the potential of ChatGPT for CLCTS as a summarizer and an evaluator.
Overall, we report evaluations from humans, ChatGPT, and several recent
automatic evaluation metrics where we find that our intermediate task finetuned
end-to-end models generate bad to moderate quality summaries; ChatGPT as a
summarizer (without any finetuning) provides moderate to good quality outputs
and as an evaluator correlates moderately with human evaluations but is prone
to giving lower scores. ChatGPT also seems very adept at normalizing historical
text and outperforms context-unaware spelling normalization tools such as
Norma. We finally test ChatGPT in a scenario with adversarially attacked and
unseen source documents and find that ChatGPT profits from its prior knowledge
to a certain degree, with better performances for omission and entity swap than
negation against its prior knowledge. This benefit inflates its assessed
quality as ChatGPT performs slightly worse for unseen source documents compared
to seen documents. We additionally introspect our models' performances to find
that longer, older and more complex source texts (all of which are more
characteristic for historical language variants) are harder to summarize for
all models, indicating the difficulty of the CLCTS task.
