Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: ScienceWorld: Is your Agent Smarter than a 5th Grader?   This paper presents a new benchmark, ScienceWorld, to test agents' scientific
reasoning abilities in a new interactive text environment at the level of a
standard elementary school science curriculum. Despite the recent
transformer-based progress seen in adjacent fields such as question-answering,
scientific text processing, and the wider area of natural language processing,
we find that current state-of-the-art models are unable to reason about or
explain learned science concepts in novel contexts. For instance, models can
easily answer what the conductivity of a previously seen material is but
struggle when asked how they would conduct an experiment in a grounded,
interactive environment to find the conductivity of an unknown material. This
begs the question of whether current models are simply retrieving answers by
way of seeing a large number of similar input examples or if they have learned
to reason about concepts in a reusable manner. We hypothesize that agents need
to be grounded in interactive environments to achieve such reasoning
capabilities. Our experiments provide empirical evidence supporting this
hypothesis -- showing that a 1.5 million parameter agent trained interactively
for 100k steps outperforms a 11 billion parameter model statically trained for
scientific question-answering and reasoning via millions of expert
demonstrations.

20
The categories of this paper are: acc-phys
16
The categories of this paper are: stat
13
The categories of this paper are: quant-ph
17
The categories of this paper are: q-fin
37
The categories of this paper are: supr-con
15
The categories of this paper are: nucl-ex
21
The categories of this paper are: adap-org
10
The categories of this paper are: q-bio
5
The categories of this paper are: gr-qc
18
The categories of this paper are: econ
11
The categories of this paper are: hep-lat
29
The categories of this paper are: funct-an
27
The categories of this paper are: comp-gas
22
The categories of this paper are: chao-dyn
32
The categories of this paper are: atom-ph
34
The categories of this paper are: chem-ph