Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On the Reliable Detection of Concept Drift from Streaming Unlabeled Data   Classifiers deployed in the real world operate in a dynamic environment,
where the data distribution can change over time. These changes, referred to as
concept drift, can cause the predictive performance of the classifier to drop
over time, thereby making it obsolete. To be of any real use, these classifiers
need to detect drifts and be able to adapt to them, over time. Detecting drifts
has traditionally been approached as a supervised task, with labeled data
constantly being used for validating the learned model. Although effective in
detecting drifts, these techniques are impractical, as labeling is a difficult,
costly and time consuming activity. On the other hand, unsupervised change
detection techniques are unreliable, as they produce a large number of false
alarms. The inefficacy of the unsupervised techniques stems from the exclusion
of the characteristics of the learned classifier, from the detection process.
In this paper, we propose the Margin Density Drift Detection (MD3) algorithm,
which tracks the number of samples in the uncertainty region of a classifier,
as a metric to detect drift. The MD3 algorithm is a distribution independent,
application independent, model independent, unsupervised and incremental
algorithm for reliably detecting drifts from data streams. Experimental
evaluation on 6 drift induced datasets and 4 additional datasets from the
cybersecurity domain demonstrates that the MD3 approach can reliably detect
drifts, with significantly fewer false alarms compared to unsupervised feature
based drift detectors. The reduced false alarms enables the signaling of drifts
only when they are most likely to affect classification performance. As such,
the MD3 approach leads to a detection scheme which is credible, label efficient
and general in its applicability.

14
The categories of this paper are: math-ph
28
The categories of this paper are: alg-geom
12
The categories of this paper are: nucl-th
26
The categories of this paper are: bayes-an
7
The categories of this paper are: hep-th
15
The categories of this paper are: nucl-ex
9
The categories of this paper are: nlin
32
The categories of this paper are: atom-ph
5
The categories of this paper are: gr-qc
20
The categories of this paper are: acc-phys
0
The categories of this paper are: hep-ph
23
The categories of this paper are: solv-int
24
The categories of this paper are: dg-ga
25
The categories of this paper are: patt-sol
21
The categories of this paper are: adap-org
30
The categories of this paper are: q-alg