Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Defeating duplicates: A re-design of the LearnedSort algorithm   LearnedSort is a novel sorting algorithm that, unlike traditional methods,
uses fast ML models to boost the sorting speed. The models learn to estimate
the input's distribution and arrange the keys in sorted order by predicting
their empirical cumulative distribution function (eCDF) values. LearnedSort has
shown outstanding performance compared to state-of-the-art sorting algorithms
on several datasets, both synthetic and real. However, given the nature of the
eCDF model, its performance is affected in the cases when the input data
contains a large number of repeated keys (i.e., duplicates). This work analyzes
this scenario in depth and introduces LearnedSort 2.0: a re-design of the
algorithm that addresses this issue and enables the algorithm to maintain the
leading edge even for high-duplicate inputs. Our extensive benchmarks on a
large set of diverse datasets demonstrate that the new design performs at much
higher sorting rates than the original version: an average of 4.78x improvement
for high-duplicate datasets, and 1.60x for low-duplicate datasets while taking
the lead among sorting algorithms.

19
The categories of this paper are: eess
22
The categories of this paper are: chao-dyn
29
The categories of this paper are: funct-an
36
The categories of this paper are: cmp-lg
37
The categories of this paper are: supr-con
2
The categories of this paper are: math
28
The categories of this paper are: alg-geom
23
The categories of this paper are: solv-int
30
The categories of this paper are: q-alg
21
The categories of this paper are: adap-org
6
The categories of this paper are: astro-ph
31
The categories of this paper are: ao-sci
10
The categories of this paper are: q-bio
5
The categories of this paper are: gr-qc
3
The categories of this paper are: physics
14
The categories of this paper are: math-ph