Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Penalized k-means algorithms for finding the correct number of clusters
  in a dataset   In many applications we want to find the number of clusters in a dataset. A
common approach is to use the penalized k-means algorithm with an additive
penalty term linear in the number of clusters. An open problem is estimating
the value of the coefficient of the penalty term. Since estimating the value of
the coefficient in a principled manner appears to be intractable for general
clusters, we investigate "ideal clusters", i.e. identical spherical clusters
with no overlaps and no outlier background noise. In this paper: (a) We derive,
for the case of ideal clusters, rigorous bounds for the coefficient of the
additive penalty. Unsurprisingly, the bounds depend on the correct number of
clusters, which we want to find in the first place. We further show that
additive penalty, even for this simplest case of ideal clusters, typically
produces a weak and often ambiguous signature for the correct number of
clusters. (b) As an alternative, we examine the k-means with multiplicative
penalty, and show that this parameter-free formulation has a stronger, and less
often ambiguous, signature for the correct number of clusters. We also
empirically investigate certain types of deviations from ideal cluster
assumption and show that combination of k-means with additive and
multiplicative penalties can resolve ambiguous solutions.

31
The categories of this paper are: ao-sci
3
The categories of this paper are: physics
21
The categories of this paper are: adap-org
13
The categories of this paper are: quant-ph
30
The categories of this paper are: q-alg
29
The categories of this paper are: funct-an
32
The categories of this paper are: atom-ph
20
The categories of this paper are: acc-phys
19
The categories of this paper are: eess
25
The categories of this paper are: patt-sol
26
The categories of this paper are: bayes-an
5
The categories of this paper are: gr-qc
14
The categories of this paper are: math-ph
22
The categories of this paper are: chao-dyn
37
The categories of this paper are: supr-con
17
The categories of this paper are: q-fin