Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Hurtful Words: Quantifying Biases in Clinical Contextual Word Embeddings   In this work, we examine the extent to which embeddings may encode
marginalized populations differently, and how this may lead to a perpetuation
of biases and worsened performance on clinical tasks. We pretrain deep
embedding models (BERT) on medical notes from the MIMIC-III hospital dataset,
and quantify potential disparities using two approaches. First, we identify
dangerous latent relationships that are captured by the contextual word
embeddings using a fill-in-the-blank method with text from real clinical notes
and a log probability bias score quantification. Second, we evaluate
performance gaps across different definitions of fairness on over 50 downstream
clinical prediction tasks that include detection of acute and chronic
conditions. We find that classifiers trained from BERT representations exhibit
statistically significant differences in performance, often favoring the
majority group with regards to gender, language, ethnicity, and insurance
status. Finally, we explore shortcomings of using adversarial debiasing to
obfuscate subgroup information in contextual word embeddings, and recommend
best practices for such deep embedding models in clinical settings.

7
The categories of this paper are: hep-th
15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys
33
The categories of this paper are: plasm-ph
10
The categories of this paper are: q-bio
22
The categories of this paper are: chao-dyn
8
The categories of this paper are: hep-ex
23
The categories of this paper are: solv-int
28
The categories of this paper are: alg-geom
31
The categories of this paper are: ao-sci
9
The categories of this paper are: nlin
27
The categories of this paper are: comp-gas
35
The categories of this paper are: mtrl-th
3
The categories of this paper are: physics
37
The categories of this paper are: supr-con
21
The categories of this paper are: adap-org