Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Constraints Satisfiability Driven Reinforcement Learning for Autonomous
  Cyber Defense   With the increasing system complexity and attack sophistication, the
necessity of autonomous cyber defense becomes vivid for cyber and
cyber-physical systems (CPSs). Many existing frameworks in the current
state-of-the-art either rely on static models with unrealistic assumptions, or
fail to satisfy the system safety and security requirements. In this paper, we
present a new hybrid autonomous agent architecture that aims to optimize and
verify defense policies of reinforcement learning (RL) by incorporating
constraints verification (using satisfiability modulo theory (SMT)) into the
agent's decision loop. The incorporation of SMT does not only ensure the
satisfiability of safety and security requirements, but also provides constant
feedback to steer the RL decision-making toward safe and effective actions.
This approach is critically needed for CPSs that exhibit high risk due to
safety or security violations. Our evaluation of the presented approach in a
simulated CPS environment shows that the agent learns the optimal policy fast
and defeats diversified attack strategies in 99\% cases.

6
The categories of this paper are: astro-ph
21
The categories of this paper are: adap-org
24
The categories of this paper are: dg-ga
18
The categories of this paper are: econ
36
The categories of this paper are: cmp-lg
27
The categories of this paper are: comp-gas
26
The categories of this paper are: bayes-an
0
The categories of this paper are: hep-ph
8
The categories of this paper are: hep-ex
35
The categories of this paper are: mtrl-th
28
The categories of this paper are: alg-geom
13
The categories of this paper are: quant-ph
20
The categories of this paper are: acc-phys
15
The categories of this paper are: nucl-ex
30
The categories of this paper are: q-alg
25
The categories of this paper are: patt-sol