Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Connecting First and Second Order Recurrent Networks with Deterministic
  Finite Automata   We propose an approach that connects recurrent networks with different orders
of hidden interaction with regular grammars of different levels of complexity.
We argue that the correspondence between recurrent networks and formal
computational models gives understanding to the analysis of the complicated
behaviors of recurrent networks. We introduce an entropy value that categorizes
all regular grammars into three classes with different levels of complexity,
and show that several existing recurrent networks match grammars from either
all or partial classes. As such, the differences between regular grammars
reveal the different properties of these models. We also provide a unification
of all investigated recurrent networks. Our evaluation shows that the unified
recurrent network has improved performance in learning grammars, and
demonstrates comparable performance on a real-world dataset with more
complicated models.

12
The categories of this paper are: nucl-th
34
The categories of this paper are: chem-ph
21
The categories of this paper are: adap-org
33
The categories of this paper are: plasm-ph
4
The categories of this paper are: cond-mat
31
The categories of this paper are: ao-sci
3
The categories of this paper are: physics
26
The categories of this paper are: bayes-an
28
The categories of this paper are: alg-geom
22
The categories of this paper are: chao-dyn
30
The categories of this paper are: q-alg
6
The categories of this paper are: astro-ph
7
The categories of this paper are: hep-th
36
The categories of this paper are: cmp-lg
27
The categories of this paper are: comp-gas
20
The categories of this paper are: acc-phys