Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Design of intentional backdoors in sequential models   Recent work has demonstrated robust mechanisms by which attacks can be
orchestrated on machine learning models. In contrast to adversarial examples,
backdoor or trojan attacks embed surgically modified samples with targeted
labels in the model training process to cause the targeted model to learn to
misclassify chosen samples in the presence of specific triggers, while keeping
the model performance stable across other nominal samples. However, current
published research on trojan attacks mainly focuses on classification problems,
which ignores sequential dependency between inputs. In this paper, we propose
methods to discreetly introduce and exploit novel backdoor attacks within a
sequential decision-making agent, such as a reinforcement learning agent, by
training multiple benign and malicious policies within a single long short-term
memory (LSTM) network. We demonstrate the effectiveness as well as the damaging
impact of such attacks through initial outcomes generated from our approach,
employed on grid-world environments. We also provide evidence as well as
intuition on how the trojan trigger and malicious policy is activated.
Challenges with network size and unintentional triggers are identified and
analogies with adversarial examples are also discussed. In the end, we propose
potential approaches to defend against or serve as early detection for such
attacks. Results of our work can also be extended to many applications of LSTM
and recurrent networks.

27
The categories of this paper are: comp-gas
23
The categories of this paper are: solv-int
18
The categories of this paper are: econ
30
The categories of this paper are: q-alg
22
The categories of this paper are: chao-dyn
9
The categories of this paper are: nlin
13
The categories of this paper are: quant-ph
32
The categories of this paper are: atom-ph
29
The categories of this paper are: funct-an
5
The categories of this paper are: gr-qc
24
The categories of this paper are: dg-ga
11
The categories of this paper are: hep-lat
36
The categories of this paper are: cmp-lg
2
The categories of this paper are: math
3
The categories of this paper are: physics
12
The categories of this paper are: nucl-th