Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: What's a good imputation to predict with missing values?   How to learn a good predictor on data with missing values? Most efforts focus
on first imputing as well as possible and second learning on the completed data
to predict the outcome. Yet, this widespread practice has no theoretical
grounding. Here we show that for almost all imputation functions, an
impute-then-regress procedure with a powerful learner is Bayes optimal. This
result holds for all missing-values mechanisms, in contrast with the classic
statistical results that require missing-at-random settings to use imputation
in probabilistic modeling. Moreover, it implies that perfect conditional
imputation is not needed for good prediction asymptotically. In fact, we show
that on perfectly imputed data the best regression function will generally be
discontinuous, which makes it hard to learn. Crafting instead the imputation so
as to leave the regression function unchanged simply shifts the problem to
learning discontinuous imputations. Rather, we suggest that it is easier to
learn imputation and regression jointly. We propose such a procedure, adapting
NeuMiss, a neural network capturing the conditional links across observed and
unobserved variables whatever the missing-value pattern. Experiments confirm
that joint imputation and regression through NeuMiss is better than various two
step procedures in our experiments with finite number of samples.

29
The categories of this paper are: funct-an
17
The categories of this paper are: q-fin
27
The categories of this paper are: comp-gas
21
The categories of this paper are: adap-org
28
The categories of this paper are: alg-geom
10
The categories of this paper are: q-bio
30
The categories of this paper are: q-alg
33
The categories of this paper are: plasm-ph
12
The categories of this paper are: nucl-th
8
The categories of this paper are: hep-ex
6
The categories of this paper are: astro-ph
7
The categories of this paper are: hep-th
23
The categories of this paper are: solv-int
26
The categories of this paper are: bayes-an
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph