Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Uniform reliability tests for forecasting systems with small lead time   A long noted difficulty when assessing the reliability (or calibration) of
forecasting systems is that reliability, in general, is a hypothesis not about
a finite dimensional parameter but about an entire functional relationship. A
calibrated probability forecast for binary events for instance should equal the
conditional probability of the event given the forecast for {\em any} value of
the forecast. Attempts to estimate deviations from calibration at a specific
forecast value meet with the difficulty that the probability of the forecast
assuming that value is typically zero. Considering the estimated {\em
cumulative} deviations from reliability instead however, tests are presented
for which the asymptotic distribution of the test statistic can be established
rigorously. The distribution turns out to be universal, provided the forecasts
"look one step ahead" only, or in other words, verify at the next time step in
the future. Furthermore, the tests develop power against a wide class of
alternatives. Numerical experiments for both artificial data as well as
operational weather forecasting systems are also presented, as are possible
extensions to forecasts with longer lead times.

31
The categories of this paper are: ao-sci
30
The categories of this paper are: q-alg
27
The categories of this paper are: comp-gas
24
The categories of this paper are: dg-ga
0
The categories of this paper are: hep-ph
10
The categories of this paper are: q-bio
35
The categories of this paper are: mtrl-th
2
The categories of this paper are: math
28
The categories of this paper are: alg-geom
33
The categories of this paper are: plasm-ph
36
The categories of this paper are: cmp-lg
4
The categories of this paper are: cond-mat
1
The categories of this paper are: cs
37
The categories of this paper are: supr-con
6
The categories of this paper are: astro-ph
15
The categories of this paper are: nucl-ex