Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Progress Notes Classification and Keyword Extraction using
  Attention-based Deep Learning Models with BERT   Various deep learning algorithms have been developed to analyze different
types of clinical data including clinical text classification and extracting
information from 'free text' and so on. However, automate the keyword
extraction from the clinical notes is still challenging. The challenges include
dealing with noisy clinical notes which contain various abbreviations, possible
typos, and unstructured sentences. The objective of this research is to
investigate the attention-based deep learning models to classify the
de-identified clinical progress notes extracted from a real-world EHR system.
The attention-based deep learning models can be used to interpret the models
and understand the critical words that drive the correct or incorrect
classification of the clinical progress notes. The attention-based models in
this research are capable of presenting the human interpretable text
classification models. The results show that the fine-tuned BERT with the
attention layer can achieve a high classification accuracy of 97.6%, which is
higher than the baseline fine-tuned BERT classification model. In this
research, we also demonstrate that the attention-based models can identify
relevant keywords that are strongly related to the clinical progress note
categories.

34
The categories of this paper are: chem-ph
23
The categories of this paper are: solv-int
8
The categories of this paper are: hep-ex
36
The categories of this paper are: cmp-lg
26
The categories of this paper are: bayes-an
13
The categories of this paper are: quant-ph
9
The categories of this paper are: nlin
4
The categories of this paper are: cond-mat
30
The categories of this paper are: q-alg
11
The categories of this paper are: hep-lat
0
The categories of this paper are: hep-ph
2
The categories of this paper are: math
25
The categories of this paper are: patt-sol
37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
27
The categories of this paper are: comp-gas