Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A Discrepancy-Based Design for A/B Testing Experiments   The aim of this paper is to introduce a new design of experiment method for
A/B tests in order to balance the covariate information in all treatment
groups. A/B tests (or "A/B/n tests") refer to the experiments and the
corresponding inference on the treatment effect(s) of a two-level or
multi-level controllable experimental factor. The common practice is to use a
randomized design and perform hypothesis tests on the estimates. However, such
estimation and inference are not always accurate when covariate imbalance
exists among the treatment groups. To overcome this issue, we propose a
discrepancy-based criterion and show that the design minimizing this criterion
significantly improves the accuracy of the treatment effect(s) estimates. The
discrepancy-based criterion is model-free and thus makes the estimation of the
treatment effect(s) robust to the model assumptions. More importantly, the
proposed design is applicable to both continuous and categorical response
measurements. We develop two efficient algorithms to construct the designs by
optimizing the criterion for both offline and online A/B tests. Through
simulation study and a real example, we show that the proposed design approach
achieves good covariate balance and accurate estimation.

33
The categories of this paper are: plasm-ph
1
The categories of this paper are: cs
5
The categories of this paper are: gr-qc
18
The categories of this paper are: econ
0
The categories of this paper are: hep-ph
13
The categories of this paper are: quant-ph
6
The categories of this paper are: astro-ph
36
The categories of this paper are: cmp-lg
9
The categories of this paper are: nlin
4
The categories of this paper are: cond-mat
10
The categories of this paper are: q-bio
14
The categories of this paper are: math-ph
7
The categories of this paper are: hep-th
37
The categories of this paper are: supr-con
28
The categories of this paper are: alg-geom
34
The categories of this paper are: chem-ph