Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Irrational Exuberance: Correcting Bias in Probability Estimates   We consider the common setting where one observes probability estimates for a
large number of events, such as default risks for numerous bonds.
Unfortunately, even with unbiased estimates, selecting events corresponding to
the most extreme probabilities can result in systematically underestimating the
true level of uncertainty. We develop an empirical Bayes approach "Excess
Certainty Adjusted Probabilities" (ECAP), using a variant of Tweedie's formula,
which updates probability estimates to correct for selection bias. ECAP is a
flexible non-parametric method, which directly estimates the score function
associated with the probability estimates, so it does not need to make any
restrictive assumptions about the prior on the true probabilities. ECAP also
works well in settings where the probability estimates are biased. We
demonstrate through theoretical results, simulations, and an analysis of two
real world data sets, that ECAP can provide significant improvements over the
original probability estimates.

17
The categories of this paper are: q-fin
0
The categories of this paper are: hep-ph
34
The categories of this paper are: chem-ph
11
The categories of this paper are: hep-lat
14
The categories of this paper are: math-ph
8
The categories of this paper are: hep-ex
27
The categories of this paper are: comp-gas
1
The categories of this paper are: cs
31
The categories of this paper are: ao-sci
19
The categories of this paper are: eess
33
The categories of this paper are: plasm-ph
12
The categories of this paper are: nucl-th
20
The categories of this paper are: acc-phys
24
The categories of this paper are: dg-ga
28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org