Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Stable Prediction with Model Misspecification and Agnostic Distribution
  Shift   For many machine learning algorithms, two main assumptions are required to
guarantee performance. One is that the test data are drawn from the same
distribution as the training data, and the other is that the model is correctly
specified. In real applications, however, we often have little prior knowledge
on the test data and on the underlying true model. Under model
misspecification, agnostic distribution shift between training and test data
leads to inaccuracy of parameter estimation and instability of prediction
across unknown test data. To address these problems, we propose a novel
Decorrelated Weighting Regression (DWR) algorithm which jointly optimizes a
variable decorrelation regularizer and a weighted regression model. The
variable decorrelation regularizer estimates a weight for each sample such that
variables are decorrelated on the weighted training data. Then, these weights
are used in the weighted regression to improve the accuracy of estimation on
the effect of each variable, thus help to improve the stability of prediction
across unknown test data. Extensive experiments clearly demonstrate that our
DWR algorithm can significantly improve the accuracy of parameter estimation
and stability of prediction with model misspecification and agnostic
distribution shift.

19
The categories of this paper are: eess
5
The categories of this paper are: gr-qc
13
The categories of this paper are: quant-ph
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
29
The categories of this paper are: funct-an
37
The categories of this paper are: supr-con
17
The categories of this paper are: q-fin
20
The categories of this paper are: acc-phys
31
The categories of this paper are: ao-sci
24
The categories of this paper are: dg-ga
7
The categories of this paper are: hep-th
2
The categories of this paper are: math
30
The categories of this paper are: q-alg
28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org