Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Domain-Specific Pretraining for Vertical Search: Case Study on
  Biomedical Literature   Information overload is a prevalent challenge in many high-value domains. A
prominent case in point is the explosion of the biomedical literature on
COVID-19, which swelled to hundreds of thousands of papers in a matter of
months. In general, biomedical literature expands by two papers every minute,
totalling over a million new papers every year. Search in the biomedical realm,
and many other vertical domains is challenging due to the scarcity of direct
supervision from click logs. Self-supervised learning has emerged as a
promising direction to overcome the annotation bottleneck. We propose a general
approach for vertical search based on domain-specific pretraining and present a
case study for the biomedical domain. Despite being substantially simpler and
not using any relevance labels for training or development, our method performs
comparably or better than the best systems in the official TREC-COVID
evaluation, a COVID-related biomedical search competition. Using distributed
computing in modern cloud infrastructure, our system can scale to tens of
millions of articles on PubMed and has been deployed as Microsoft Biomedical
Search, a new search experience for biomedical literature:
https://aka.ms/biomedsearch.

34
The categories of this paper are: chem-ph
29
The categories of this paper are: funct-an
19
The categories of this paper are: eess
2
The categories of this paper are: math
28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org
23
The categories of this paper are: solv-int
18
The categories of this paper are: econ
3
The categories of this paper are: physics
16
The categories of this paper are: stat
7
The categories of this paper are: hep-th
33
The categories of this paper are: plasm-ph
20
The categories of this paper are: acc-phys
22
The categories of this paper are: chao-dyn
11
The categories of this paper are: hep-lat
31
The categories of this paper are: ao-sci