Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Improving Robustness to Model Inversion Attacks via Mutual Information
  Regularization   This paper studies defense mechanisms against model inversion (MI) attacks --
a type of privacy attacks aimed at inferring information about the training
data distribution given the access to a target machine learning model. Existing
defense mechanisms rely on model-specific heuristics or noise injection. While
being able to mitigate attacks, existing methods significantly hinder model
performance. There remains a question of how to design a defense mechanism that
is applicable to a variety of models and achieves better utility-privacy
tradeoff. In this paper, we propose the Mutual Information Regularization based
Defense (MID) against MI attacks. The key idea is to limit the information
about the model input contained in the prediction, thereby limiting the ability
of an adversary to infer the private training attributes from the model
prediction. Our defense principle is model-agnostic and we present tractable
approximations to the regularizer for linear regression, decision trees, and
neural networks, which have been successfully attacked by prior work if not
attached with any defenses. We present a formal study of MI attacks by devising
a rigorous game-based definition and quantifying the associated information
leakage. Our theoretical analysis sheds light on the inefficacy of DP in
defending against MI attacks, which has been empirically observed in several
prior works. Our experiments demonstrate that MID leads to state-of-the-art
performance for a variety of MI attacks, target models and datasets.

7
The categories of this paper are: hep-th
30
The categories of this paper are: q-alg
3
The categories of this paper are: physics
28
The categories of this paper are: alg-geom
2
The categories of this paper are: math
12
The categories of this paper are: nucl-th
13
The categories of this paper are: quant-ph
31
The categories of this paper are: ao-sci
36
The categories of this paper are: cmp-lg
4
The categories of this paper are: cond-mat
25
The categories of this paper are: patt-sol
20
The categories of this paper are: acc-phys
19
The categories of this paper are: eess
37
The categories of this paper are: supr-con
26
The categories of this paper are: bayes-an
14
The categories of this paper are: math-ph