Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Holdout-Based Fidelity and Privacy Assessment of Mixed-Type Synthetic
  Data   AI-based data synthesis has seen rapid progress over the last several years,
and is increasingly recognized for its promise to enable privacy-respecting
high-fidelity data sharing. However, adequately evaluating the quality of
generated synthetic datasets is still an open challenge. We introduce and
demonstrate a holdout-based empirical assessment framework for quantifying the
fidelity as well as the privacy risk of synthetic data solutions for mixed-type
tabular data. Measuring fidelity is based on statistical distances of
lower-dimensional marginal distributions, which provide a model-free and
easy-to-communicate empirical metric for the representativeness of a synthetic
dataset. Privacy risk is assessed by calculating the individual-level distances
to closest record with respect to the training data. By showing that the
synthetic samples are just as close to the training as to the holdout data, we
yield strong evidence that the synthesizer indeed learned to generalize
patterns and is independent of individual training records. We demonstrate the
presented framework for seven distinct synthetic data solutions across four
mixed-type datasets and compare these to more traditional statistical
disclosure techniques. The results highlight the need to systematically assess
the fidelity just as well as the privacy of these emerging class of synthetic
data generators.

33
The categories of this paper are: plasm-ph
10
The categories of this paper are: q-bio
0
The categories of this paper are: hep-ph
2
The categories of this paper are: math
3
The categories of this paper are: physics
34
The categories of this paper are: chem-ph
4
The categories of this paper are: cond-mat
19
The categories of this paper are: eess
30
The categories of this paper are: q-alg
37
The categories of this paper are: supr-con
28
The categories of this paper are: alg-geom
23
The categories of this paper are: solv-int
5
The categories of this paper are: gr-qc
9
The categories of this paper are: nlin
18
The categories of this paper are: econ
27
The categories of this paper are: comp-gas