Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Universal Spam Detection using Transfer Learning of BERT Model   Deep learning transformer models become important by training on text data
based on self-attention mechanisms. This manuscript demonstrated a novel
universal spam detection model using pre-trained Google's Bidirectional Encoder
Representations from Transformers (BERT) base uncased models with four datasets
by efficiently classifying ham or spam emails in real-time scenarios. Different
methods for Enron, Spamassain, Lingspam, and Spamtext message classification
datasets, were used to train models individually in which a single model was
obtained with acceptable performance on four datasets. The Universal Spam
Detection Model (USDM) was trained with four datasets and leveraged
hyperparameters from each model. The combined model was finetuned with the same
hyperparameters from these four models separately. When each model using its
corresponding dataset, an F1-score is at and above 0.9 in individual models. An
overall accuracy reached 97%, with an F1 score of 0.96. Research results and
implications were discussed.

32
The categories of this paper are: atom-ph
22
The categories of this paper are: chao-dyn
13
The categories of this paper are: quant-ph
11
The categories of this paper are: hep-lat
8
The categories of this paper are: hep-ex
37
The categories of this paper are: supr-con
21
The categories of this paper are: adap-org
30
The categories of this paper are: q-alg
0
The categories of this paper are: hep-ph
15
The categories of this paper are: nucl-ex
24
The categories of this paper are: dg-ga
3
The categories of this paper are: physics
25
The categories of this paper are: patt-sol
36
The categories of this paper are: cmp-lg
12
The categories of this paper are: nucl-th
7
The categories of this paper are: hep-th