Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Distill-and-Compare: Auditing Black-Box Models Using Transparent Model
  Distillation   Black-box risk scoring models permeate our lives, yet are typically
proprietary or opaque. We propose Distill-and-Compare, a model distillation and
comparison approach to audit such models. To gain insight into black-box
models, we treat them as teachers, training transparent student models to mimic
the risk scores assigned by black-box models. We compare the student model
trained with distillation to a second un-distilled transparent model trained on
ground-truth outcomes, and use differences between the two models to gain
insight into the black-box model. Our approach can be applied in a realistic
setting, without probing the black-box model API. We demonstrate the approach
on four public data sets: COMPAS, Stop-and-Frisk, Chicago Police, and Lending
Club. We also propose a statistical test to determine if a data set is missing
key features used to train the black-box model. Our test finds that the
ProPublica data is likely missing key feature(s) used in COMPAS.

8
The categories of this paper are: hep-ex
3
The categories of this paper are: physics
29
The categories of this paper are: funct-an
19
The categories of this paper are: eess
7
The categories of this paper are: hep-th
10
The categories of this paper are: q-bio
25
The categories of this paper are: patt-sol
27
The categories of this paper are: comp-gas
21
The categories of this paper are: adap-org
30
The categories of this paper are: q-alg
13
The categories of this paper are: quant-ph
32
The categories of this paper are: atom-ph
31
The categories of this paper are: ao-sci
4
The categories of this paper are: cond-mat
24
The categories of this paper are: dg-ga
22
The categories of this paper are: chao-dyn