Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On Recurrent Neural Networks for Sequence-based Processing in
  Communications   In this work, we analyze the capabilities and practical limitations of neural
networks (NNs) for sequence-based signal processing which can be seen as an
omnipresent property in almost any modern communication systems. In particular,
we train multiple state-of-the-art recurrent neural network (RNN) structures to
learn how to decode convolutional codes allowing a clear benchmarking with the
corresponding maximum likelihood (ML) Viterbi decoder. We examine the decoding
performance for various kinds of NN architectures, beginning with classical
types like feedforward layers and gated recurrent unit (GRU)-layers, up to more
recently introduced architectures such as temporal convolutional networks
(TCNs) and differentiable neural computers (DNCs) with external memory. As a
key limitation, it turns out that the training complexity increases
exponentially with the length of the encoding memory $\nu$ and, thus,
practically limits the achievable bit error rate (BER) performance. To overcome
this limitation, we introduce a new training-method by gradually increasing the
number of ones within the training sequences, i.e., we constrain the amount of
possible training sequences in the beginning until first convergence. By
consecutively adding more and more possible sequences to the training set, we
finally achieve training success in cases that did not converge before via
naive training. Further, we show that our network can learn to jointly detect
and decode a quadrature phase shift keying (QPSK) modulated code with
sub-optimal (anti-Gray) labeling in one-shot at a performance that would
require iterations between demapper and decoder in classic detection schemes.

20
The categories of this paper are: acc-phys
21
The categories of this paper are: adap-org
32
The categories of this paper are: atom-ph
6
The categories of this paper are: astro-ph
23
The categories of this paper are: solv-int
8
The categories of this paper are: hep-ex
28
The categories of this paper are: alg-geom
24
The categories of this paper are: dg-ga
27
The categories of this paper are: comp-gas
37
The categories of this paper are: supr-con
29
The categories of this paper are: funct-an
13
The categories of this paper are: quant-ph
14
The categories of this paper are: math-ph
26
The categories of this paper are: bayes-an
12
The categories of this paper are: nucl-th
10
The categories of this paper are: q-bio