Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Probabilistic Models for Query Approximation with Large Sparse Binary
  Datasets   Large sparse sets of binary transaction data with millions of records and
thousands of attributes occur in various domains: customers purchasing
products, users visiting web pages, and documents containing words are just
three typical examples. Real-time query selectivity estimation (the problem of
estimating the number of rows in the data satisfying a given predicate) is an
important practical problem for such databases.
  We investigate the application of probabilistic models to this problem. In
particular, we study a Markov random field (MRF) approach based on frequent
sets and maximum entropy, and compare it to the independence model and the
Chow-Liu tree model. We find that the MRF model provides substantially more
accurate probability estimates than the other methods but is more expensive
from a computational and memory viewpoint. To alleviate the computational
requirements we show how one can apply bucket elimination and clique tree
approaches to take advantage of structure in the models and in the queries. We
provide experimental results on two large real-world transaction datasets.

0
The categories of this paper are: hep-ph
34
The categories of this paper are: chem-ph
7
The categories of this paper are: hep-th
17
The categories of this paper are: q-fin
19
The categories of this paper are: eess
8
The categories of this paper are: hep-ex
11
The categories of this paper are: hep-lat
3
The categories of this paper are: physics
30
The categories of this paper are: q-alg
24
The categories of this paper are: dg-ga
27
The categories of this paper are: comp-gas
6
The categories of this paper are: astro-ph
29
The categories of this paper are: funct-an
23
The categories of this paper are: solv-int
31
The categories of this paper are: ao-sci
20
The categories of this paper are: acc-phys