Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Contextualized Word Embeddings Encode Aspects of Human-Like Word Sense
  Knowledge   Understanding context-dependent variation in word meanings is a key aspect of
human language comprehension supported by the lexicon. Lexicographic resources
(e.g., WordNet) capture only some of this context-dependent variation; for
example, they often do not encode how closely senses, or discretized word
meanings, are related to one another. Our work investigates whether recent
advances in NLP, specifically contextualized word embeddings, capture
human-like distinctions between English word senses, such as polysemy and
homonymy. We collect data from a behavioral, web-based experiment, in which
participants provide judgments of the relatedness of multiple WordNet senses of
a word in a two-dimensional spatial arrangement task. We find that
participants' judgments of the relatedness between senses are correlated with
distances between senses in the BERT embedding space. Homonymous senses (e.g.,
bat as mammal vs. bat as sports equipment) are reliably more distant from one
another in the embedding space than polysemous ones (e.g., chicken as animal
vs. chicken as meat). Our findings point towards the potential utility of
continuous-space representations of sense meanings.

22
The categories of this paper are: chao-dyn
13
The categories of this paper are: quant-ph
21
The categories of this paper are: adap-org
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
33
The categories of this paper are: plasm-ph
18
The categories of this paper are: econ
15
The categories of this paper are: nucl-ex
36
The categories of this paper are: cmp-lg
34
The categories of this paper are: chem-ph
24
The categories of this paper are: dg-ga
6
The categories of this paper are: astro-ph
16
The categories of this paper are: stat
12
The categories of this paper are: nucl-th