Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Towards Joint Intent Detection and Slot Filling via Higher-order
  Attention   Intent detection (ID) and Slot filling (SF) are two major tasks in spoken
language understanding (SLU). Recently, attention mechanism has been shown to
be effective in jointly optimizing these two tasks in an interactive manner.
However, latest attention-based works concentrated only on the first-order
attention design, while ignoring the exploration of higher-order attention
mechanisms. In this paper, we propose a BiLinear attention block, which
leverages bilinear pooling to simultaneously exploit both the contextual and
channel-wise bilinear attention distributions to capture the second-order
interactions between the input intent or slot features. Higher and even
infinity order interactions are built by stacking numerous blocks and assigning
Exponential Linear Unit (ELU) to blocks. Before the decoding stage, we
introduce the Dynamic Feature Fusion Layer to implicitly fuse intent and slot
information in a more effective way. Technically, instead of simply
concatenating intent and slot features, we first compute two correlation
matrices to weight on two features. Furthermore, we present Higher-order
Attention Network for the SLU tasks. Experiments on two benchmark datasets show
that our approach yields improvements compared with the state-of-the-art
approach. We also provide discussion to demonstrate the effectiveness of the
proposed approach.

10
The categories of this paper are: q-bio
30
The categories of this paper are: q-alg
14
The categories of this paper are: math-ph
7
The categories of this paper are: hep-th
9
The categories of this paper are: nlin
20
The categories of this paper are: acc-phys
26
The categories of this paper are: bayes-an
33
The categories of this paper are: plasm-ph
6
The categories of this paper are: astro-ph
23
The categories of this paper are: solv-int
24
The categories of this paper are: dg-ga
25
The categories of this paper are: patt-sol
15
The categories of this paper are: nucl-ex
4
The categories of this paper are: cond-mat
12
The categories of this paper are: nucl-th
13
The categories of this paper are: quant-ph