Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Open Benchmarking for Click-Through Rate Prediction   Click-through rate (CTR) prediction is a critical task for many applications,
as its accuracy has a direct impact on user experience and platform revenue. In
recent years, CTR prediction has been widely studied in both academia and
industry, resulting in a wide variety of CTR prediction models. Unfortunately,
there is still a lack of standardized benchmarks and uniform evaluation
protocols for CTR prediction research. This leads to non-reproducible or even
inconsistent experimental results among existing studies, which largely limit
the practical value and potential impact of their research. In this work, we
aim to perform open benchmarking for CTR prediction and present a rigorous
comparison of different models in a reproducible manner. To this end, we ran
{over 7,000 experiments for more than 12,000 GPU hours in total to re-evaluate
24 existing models} on multiple dataset settings. Surprisingly, our experiments
show that with sufficient hyper-parameter search and model tuning, many deep
models have smaller differences than expected. The results also reveal that
making real progress on the modeling of CTR prediction is indeed a very
challenging research task. We believe that our benchmarking work could not only
allow researchers to gauge the effectiveness of new models conveniently but
also make them fairly compare with the state of the arts. We have publicly
released the benchmarking tools, evaluation protocols, and experimental
settings of our work to promote reproducible research in this field.

29
The categories of this paper are: funct-an
19
The categories of this paper are: eess
0
The categories of this paper are: hep-ph
18
The categories of this paper are: econ
34
The categories of this paper are: chem-ph
24
The categories of this paper are: dg-ga
3
The categories of this paper are: physics
8
The categories of this paper are: hep-ex
23
The categories of this paper are: solv-int
21
The categories of this paper are: adap-org
4
The categories of this paper are: cond-mat
32
The categories of this paper are: atom-ph
15
The categories of this paper are: nucl-ex
9
The categories of this paper are: nlin
33
The categories of this paper are: plasm-ph
7
The categories of this paper are: hep-th