Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Compacting the Penn Treebank Grammar   Treebanks, such as the Penn Treebank (PTB), offer a simple approach to
obtaining a broad coverage grammar: one can simply read the grammar off the
parse trees in the treebank. While such a grammar is easy to obtain, a
square-root rate of growth of the rule set with corpus size suggests that the
derived grammar is far from complete and that much more treebanked text would
be required to obtain a complete grammar, if one exists at some limit. However,
we offer an alternative explanation in terms of the underspecification of
structures within the treebank. This hypothesis is explored by applying an
algorithm to compact the derived grammar by eliminating redundant rules --
rules whose right hand sides can be parsed by other rules. The size of the
resulting compacted grammar, which is significantly less than that of the full
treebank grammar, is shown to approach a limit. However, such a compacted
grammar does not yield very good performance figures. A version of the
compaction algorithm taking rule probabilities into account is proposed, which
is argued to be more linguistically motivated. Combined with simple
thresholding, this method can be used to give a 58% reduction in grammar size
without significant change in parsing performance, and can produce a 69%
reduction with some gain in recall, but a loss in precision.

20
The categories of this paper are: acc-phys
2
The categories of this paper are: math
36
The categories of this paper are: cmp-lg
5
The categories of this paper are: gr-qc
33
The categories of this paper are: plasm-ph
11
The categories of this paper are: hep-lat
13
The categories of this paper are: quant-ph
19
The categories of this paper are: eess
24
The categories of this paper are: dg-ga
7
The categories of this paper are: hep-th
35
The categories of this paper are: mtrl-th
18
The categories of this paper are: econ
17
The categories of this paper are: q-fin
0
The categories of this paper are: hep-ph
21
The categories of this paper are: adap-org
10
The categories of this paper are: q-bio