Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Improving the robustness and accuracy of biomedical language models
  through adversarial training   Deep transformer neural network models have improved the predictive accuracy
of intelligent text processing systems in the biomedical domain. They have
obtained state-of-the-art performance scores on a wide variety of biomedical
and clinical Natural Language Processing (NLP) benchmarks. However, the
robustness and reliability of these models has been less explored so far.
Neural NLP models can be easily fooled by adversarial samples, i.e. minor
changes to input that preserve the meaning and understandability of the text
but force the NLP system to make erroneous decisions. This raises serious
concerns about the security and trust-worthiness of biomedical NLP systems,
especially when they are intended to be deployed in real-world use cases. We
investigated the robustness of several transformer neural language models, i.e.
BioBERT, SciBERT, BioMed-RoBERTa, and Bio-ClinicalBERT, on a wide range of
biomedical and clinical text processing tasks. We implemented various
adversarial attack methods to test the NLP systems in different attack
scenarios. Experimental results showed that the biomedical NLP models are
sensitive to adversarial samples; their performance dropped in average by 21
and 18.9 absolute percent on character-level and word-level adversarial noise,
respectively. Conducting extensive adversarial training experiments, we
fine-tuned the NLP models on a mixture of clean samples and adversarial inputs.
Results showed that adversarial training is an effective defense mechanism
against adversarial noise; the models robustness improved in average by 11.3
absolute percent. In addition, the models performance on clean data increased
in average by 2.4 absolute present, demonstrating that adversarial training can
boost generalization abilities of biomedical NLP systems.

30
The categories of this paper are: q-alg
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
18
The categories of this paper are: econ
19
The categories of this paper are: eess
5
The categories of this paper are: gr-qc
36
The categories of this paper are: cmp-lg
23
The categories of this paper are: solv-int
27
The categories of this paper are: comp-gas
25
The categories of this paper are: patt-sol
21
The categories of this paper are: adap-org
0
The categories of this paper are: hep-ph
31
The categories of this paper are: ao-sci
24
The categories of this paper are: dg-ga
14
The categories of this paper are: math-ph
9
The categories of this paper are: nlin