Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Lifelong Neural Topic Learning in Contextualized Autoregressive Topic
  Models of Language via Informative Transfers   Topic models such as LDA, DocNADE, iDocNADEe have been popular in document
analysis. However, the traditional topic models have several limitations
including: (1) Bag-of-words (BoW) assumption, where they ignore word ordering,
(2) Data sparsity, where the application of topic models is challenging due to
limited word co-occurrences, leading to incoherent topics and (3) No Continuous
Learning framework for topic learning in lifelong fashion, exploiting
historical knowledge (or latent topics) and minimizing catastrophic forgetting.
This thesis focuses on addressing the above challenges within neural topic
modeling framework. We propose: (1) Contextualized topic model that combines a
topic and a language model and introduces linguistic structures (such as word
ordering, syntactic and semantic features, etc.) in topic modeling, (2) A novel
lifelong learning mechanism into neural topic modeling framework to demonstrate
continuous learning in sequential document collections and minimizing
catastrophic forgetting. Additionally, we perform a selective data augmentation
to alleviate the need for complete historical corpora during data hallucination
or replay.

34
The categories of this paper are: chem-ph
32
The categories of this paper are: atom-ph
19
The categories of this paper are: eess
24
The categories of this paper are: dg-ga
35
The categories of this paper are: mtrl-th
17
The categories of this paper are: q-fin
33
The categories of this paper are: plasm-ph
25
The categories of this paper are: patt-sol
26
The categories of this paper are: bayes-an
21
The categories of this paper are: adap-org
10
The categories of this paper are: q-bio
31
The categories of this paper are: ao-sci
15
The categories of this paper are: nucl-ex
5
The categories of this paper are: gr-qc
14
The categories of this paper are: math-ph
28
The categories of this paper are: alg-geom