Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: From Little Things Big Things Grow: A Collection with Seed Studies for
  Medical Systematic Review Literature Search   Medical systematic review query formulation is a highly complex task done by
trained information specialists. Complexity comes from the reliance on lengthy
Boolean queries, which express a detailed research question. To aid query
formulation, information specialists use a set of exemplar documents, called
`seed studies', prior to query formulation. Seed studies help verify the
effectiveness of a query prior to the full assessment of retrieved studies.
Beyond this use of seeds, specific IR methods can exploit seed studies for
guiding both automatic query formulation and new retrieval models. One major
limitation of work to date is that these methods exploit `pseudo seed studies'
through retrospective use of included studies (i.e., relevance assessments).
However, we show pseudo seed studies are not representative of real seed
studies used by information specialists. Hence, we provide a test collection
with real world seed studies used to assist with the formulation of queries. To
support our collection, we provide an analysis, previously not possible, on how
seed studies impact retrieval and perform several experiments using seed-study
based methods to compare the effectiveness of using seed studies versus pseudo
seed studies. We make our test collection and the results of all of our
experiments and analysis available at
http://github.com/ielab/sysrev-seed-collection

16
The categories of this paper are: stat
29
The categories of this paper are: funct-an
37
The categories of this paper are: supr-con
21
The categories of this paper are: adap-org
14
The categories of this paper are: math-ph
25
The categories of this paper are: patt-sol
12
The categories of this paper are: nucl-th
8
The categories of this paper are: hep-ex
10
The categories of this paper are: q-bio
9
The categories of this paper are: nlin
24
The categories of this paper are: dg-ga
28
The categories of this paper are: alg-geom
6
The categories of this paper are: astro-ph
0
The categories of this paper are: hep-ph
15
The categories of this paper are: nucl-ex
35
The categories of this paper are: mtrl-th