Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: RadBERT-CL: Factually-Aware Contrastive Learning For Radiology Report
  Classification   Radiology reports are unstructured and contain the imaging findings and
corresponding diagnoses transcribed by radiologists which include clinical
facts and negated and/or uncertain statements. Extracting pathologic findings
and diagnoses from radiology reports is important for quality control,
population health, and monitoring of disease progress. Existing works,
primarily rely either on rule-based systems or transformer-based pre-trained
model fine-tuning, but could not take the factual and uncertain information
into consideration, and therefore generate false-positive outputs. In this
work, we introduce three sedulous augmentation techniques which retain factual
and critical information while generating augmentations for contrastive
learning. We introduce RadBERT-CL, which fuses these information into BlueBert
via a self-supervised contrastive loss. Our experiments on MIMIC-CXR show
superior performance of RadBERT-CL on fine-tuning for multi-class, multi-label
report classification. We illustrate that when few labeled data are available,
RadBERT-CL outperforms conventional SOTA transformers (BERT/BlueBert) by
significantly larger margins (6-11%). We also show that the representations
learned by RadBERT-CL can capture critical medical information in the latent
space.

27
The categories of this paper are: comp-gas
12
The categories of this paper are: nucl-th
0
The categories of this paper are: hep-ph
17
The categories of this paper are: q-fin
21
The categories of this paper are: adap-org
34
The categories of this paper are: chem-ph
23
The categories of this paper are: solv-int
2
The categories of this paper are: math
11
The categories of this paper are: hep-lat
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
30
The categories of this paper are: q-alg
28
The categories of this paper are: alg-geom
32
The categories of this paper are: atom-ph
10
The categories of this paper are: q-bio
13
The categories of this paper are: quant-ph