Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Residual Entropy   We describe an approach to improving model fitting and model generalization
that considers the entropy of distributions of modelling residuals. We use
simple simulations to demonstrate the observational signatures of overfitting
on ordered sequences of modelling residuals, via the autocorrelation and power
spectral density. These results motivate the conclusion that, as commonly
applied, the least squares method assumes too much when it assumes that
residuals are uncorrelated for all possible models or values of the model
parameters. We relax these too-stringent assumptions in favour of imposing an
entropy prior on the (unknown, model-dependent, but potentially marginalizable)
distribution function for residuals. We recommend a simple extension to the
Mean Squared Error loss function that approximately incorporates this prior and
can be used immediately for modelling applications where meaningfully-ordered
sequences of observations or training data can be defined.

17
The categories of this paper are: q-fin
31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
21
The categories of this paper are: adap-org
23
The categories of this paper are: solv-int
18
The categories of this paper are: econ
10
The categories of this paper are: q-bio
35
The categories of this paper are: mtrl-th
3
The categories of this paper are: physics
12
The categories of this paper are: nucl-th
6
The categories of this paper are: astro-ph
14
The categories of this paper are: math-ph
13
The categories of this paper are: quant-ph
33
The categories of this paper are: plasm-ph