Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Characteristics of hand and machine-assigned scores to college students'
  answers to open-ended tasks   Assessment of learning in higher education is a critical concern to policy
makers, educators, parents, and students. And, doing so appropriately is likely
to require including constructed response tests in the assessment system. We
examined whether scoring costs and other concerns with using open-end measures
on a large scale (e.g., turnaround time and inter-reader consistency) could be
addressed by machine grading the answers. Analyses with 1359 students from 14
colleges found that two human readers agreed highly with each other in the
scores they assigned to the answers to three types of open-ended questions.
These reader assigned scores also agreed highly with those assigned by a
computer. The correlations of the machine-assigned scores with SAT scores,
college grades, and other measures were comparable to the correlations of these
variables with the hand-assigned scores. Machine scoring did not widen
differences in mean scores between racial/ethnic or gender groups. Our findings
demonstrated that machine scoring can facilitate the use of open-ended
questions in large-scale testing programs by providing a fast, accurate, and
economical way to grade responses.

8
The categories of this paper are: hep-ex
22
The categories of this paper are: chao-dyn
0
The categories of this paper are: hep-ph
31
The categories of this paper are: ao-sci
35
The categories of this paper are: mtrl-th
26
The categories of this paper are: bayes-an
17
The categories of this paper are: q-fin
33
The categories of this paper are: plasm-ph
25
The categories of this paper are: patt-sol
14
The categories of this paper are: math-ph
29
The categories of this paper are: funct-an
21
The categories of this paper are: adap-org
28
The categories of this paper are: alg-geom
13
The categories of this paper are: quant-ph
27
The categories of this paper are: comp-gas
18
The categories of this paper are: econ