Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Statistical optimality conditions for compressive ensembles   We present a framework for the theoretical analysis of ensembles of
low-complexity empirical risk minimisers trained on independent random
compressions of high-dimensional data. First we introduce a general
distribution-dependent upper-bound on the excess risk, framed in terms of a
natural notion of compressibility. This bound is independent of the dimension
of the original data representation, and explains the in-built regularisation
effect of the compressive approach. We then instantiate this general bound to
classification and regression tasks, considering Johnson-Lindenstrauss mappings
as the compression scheme. For each of these tasks, our strategy is to develop
a tight upper bound on the compressibility function, and by doing so we
discover distributional conditions of geometric nature under which the
compressive algorithm attains minimax-optimal rates up to at most
poly-logarithmic factors. In the case of compressive classification, this is
achieved with a mild geometric margin condition along with a flexible moment
condition that is significantly more general than the assumption of bounded
domain. In the case of regression with strongly convex smooth loss functions we
find that compressive regression is capable of exploiting spectral decay with
near-optimal guarantees. In addition, a key ingredient for our central upper
bound is a high probability uniform upper bound on the integrated deviation of
dependent empirical processes, which may be of independent interest.

26
The categories of this paper are: bayes-an
10
The categories of this paper are: q-bio
29
The categories of this paper are: funct-an
13
The categories of this paper are: quant-ph
21
The categories of this paper are: adap-org
28
The categories of this paper are: alg-geom
5
The categories of this paper are: gr-qc
7
The categories of this paper are: hep-th
34
The categories of this paper are: chem-ph
31
The categories of this paper are: ao-sci
22
The categories of this paper are: chao-dyn
9
The categories of this paper are: nlin
14
The categories of this paper are: math-ph
11
The categories of this paper are: hep-lat
12
The categories of this paper are: nucl-th
20
The categories of this paper are: acc-phys