Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: ERNIE-GeoL: A Geography-and-Language Pre-trained Model and its
  Applications in Baidu Maps   Pre-trained models (PTMs) have become a fundamental backbone for downstream
tasks in natural language processing and computer vision. Despite initial gains
that were obtained by applying generic PTMs to geo-related tasks at Baidu Maps,
a clear performance plateau over time was observed. One of the main reasons for
this plateau is the lack of readily available geographic knowledge in generic
PTMs. To address this problem, in this paper, we present ERNIE-GeoL, which is a
geography-and-language pre-trained model designed and developed for improving
the geo-related tasks at Baidu Maps. ERNIE-GeoL is elaborately designed to
learn a universal representation of geography-language by pre-training on
large-scale data generated from a heterogeneous graph that contains abundant
geographic knowledge. Extensive quantitative and qualitative experiments
conducted on large-scale real-world datasets demonstrate the superiority and
effectiveness of ERNIE-GeoL. ERNIE-GeoL has already been deployed in production
at Baidu Maps since April 2021, which significantly benefits the performance of
a wide range of downstream tasks. This demonstrates that ERNIE-GeoL can serve
as a fundamental backbone for geo-related tasks.

7
The categories of this paper are: hep-th
28
The categories of this paper are: alg-geom
14
The categories of this paper are: math-ph
12
The categories of this paper are: nucl-th
23
The categories of this paper are: solv-int
10
The categories of this paper are: q-bio
21
The categories of this paper are: adap-org
13
The categories of this paper are: quant-ph
15
The categories of this paper are: nucl-ex
24
The categories of this paper are: dg-ga
22
The categories of this paper are: chao-dyn
16
The categories of this paper are: stat
2
The categories of this paper are: math
8
The categories of this paper are: hep-ex
19
The categories of this paper are: eess
17
The categories of this paper are: q-fin