Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A learning problem that is independent of the set theory ZFC axioms   We consider the following statistical estimation problem: given a family F of
real valued functions over some domain X and an i.i.d. sample drawn from an
unknown distribution P over X, find h in F such that the expectation of h
w.r.t. P is probably approximately equal to the supremum over expectations on
members of F. This Expectation Maximization (EMX) problem captures many well
studied learning problems; in fact, it is equivalent to Vapnik's general
setting of learning.
  Surprisingly, we show that the EMX learnability, as well as the learning
rates of some basic class F, depend on the cardinality of the continuum and is
therefore independent of the set theory ZFC axioms (that are widely accepted as
a formalization of the notion of a mathematical proof).
  We focus on the case where the functions in F are Boolean, which generalizes
classification problems. We study the interaction between the statistical
sample complexity of F and its combinatorial structure. We introduce a new
version of sample compression schemes and show that it characterizes EMX
learnability for a wide family of classes. However, we show that for the class
of finite subsets of the real line, the existence of such compression schemes
is independent of set theory. We conclude that the learnability of that class
with respect to the family of probability distributions of countable support is
independent of the set theory ZFC axioms.
  We also explore the existence of a "VC-dimension-like" parameter that
captures learnability in this setting. Our results imply that that there exist
no "finitary" combinatorial parameter that characterizes EMX learnability in a
way similar to the VC-dimension based characterization of binary valued
classification problems.

10
The categories of this paper are: q-bio
35
The categories of this paper are: mtrl-th
36
The categories of this paper are: cmp-lg
34
The categories of this paper are: chem-ph
15
The categories of this paper are: nucl-ex
2
The categories of this paper are: math
5
The categories of this paper are: gr-qc
7
The categories of this paper are: hep-th
4
The categories of this paper are: cond-mat
24
The categories of this paper are: dg-ga
16
The categories of this paper are: stat
27
The categories of this paper are: comp-gas
0
The categories of this paper are: hep-ph
12
The categories of this paper are: nucl-th
14
The categories of this paper are: math-ph
28
The categories of this paper are: alg-geom