Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Increasing the Interpretability of Recurrent Neural Networks Using
  Hidden Markov Models   As deep neural networks continue to revolutionize various application
domains, there is increasing interest in making these powerful models more
understandable and interpretable, and narrowing down the causes of good and bad
predictions. We focus on recurrent neural networks, state of the art models in
speech recognition and translation. Our approach to increasing interpretability
is by combining a long short-term memory (LSTM) model with a hidden Markov
model (HMM), a simpler and more transparent model. We add the HMM state
probabilities to the output layer of the LSTM, and then train the HMM and LSTM
either sequentially or jointly. The LSTM can make use of the information from
the HMM, and fill in the gaps when the HMM is not performing well. A small
hybrid model usually performs better than a standalone LSTM of the same size,
especially on smaller data sets. We test the algorithms on text data and
medical time series data, and find that the LSTM and HMM learn complementary
information about the features in the text.

31
The categories of this paper are: ao-sci
34
The categories of this paper are: chem-ph
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
37
The categories of this paper are: supr-con
24
The categories of this paper are: dg-ga
18
The categories of this paper are: econ
19
The categories of this paper are: eess
9
The categories of this paper are: nlin
2
The categories of this paper are: math
13
The categories of this paper are: quant-ph
0
The categories of this paper are: hep-ph
17
The categories of this paper are: q-fin
8
The categories of this paper are: hep-ex
11
The categories of this paper are: hep-lat
32
The categories of this paper are: atom-ph