Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Corrigibility with Utility Preservation   Corrigibility is a safety property for artificially intelligent agents. A
corrigible agent will not resist attempts by authorized parties to alter the
goals and constraints that were encoded in the agent when it was first started.
This paper shows how to construct a safety layer that adds corrigibility to
arbitrarily advanced utility maximizing agents, including possible future
agents with Artificial General Intelligence (AGI). The layer counter-acts the
emergent incentive of advanced agents to resist such alteration. A detailed
model for agents which can reason about preserving their utility function is
developed, and used to prove that the corrigibility layer works as intended in
a large set of non-hostile universes. The corrigible agents have an emergent
incentive to protect key elements of their corrigibility layer. However,
hostile universes may contain forces strong enough to break safety features.
Some open problems related to graceful degradation when an agent is
successfully attacked are identified. The results in this paper were obtained
by concurrently developing an AGI agent simulator, an agent model, and proofs.
The simulator is available under an open source license. The paper contains
simulation results which illustrate the safety related properties of corrigible
AGI agents in detail.

11
The categories of this paper are: hep-lat
10
The categories of this paper are: q-bio
5
The categories of this paper are: gr-qc
3
The categories of this paper are: physics
8
The categories of this paper are: hep-ex
15
The categories of this paper are: nucl-ex
36
The categories of this paper are: cmp-lg
14
The categories of this paper are: math-ph
27
The categories of this paper are: comp-gas
16
The categories of this paper are: stat
29
The categories of this paper are: funct-an
32
The categories of this paper are: atom-ph
21
The categories of this paper are: adap-org
13
The categories of this paper are: quant-ph
25
The categories of this paper are: patt-sol
4
The categories of this paper are: cond-mat