Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Measuring the Complexity of Domains Used to Evaluate AI Systems   There is currently a rapid increase in the number of challenge problem,
benchmarking datasets and algorithmic optimization tests for evaluating AI
systems. However, there does not currently exist an objective measure to
determine the complexity between these newly created domains. This lack of
cross-domain examination creates an obstacle to effectively research more
general AI systems. We propose a theory for measuring the complexity between
varied domains. This theory is then evaluated using approximations by a
population of neural network based AI systems. The approximations are compared
to other well known standards and show it meets intuitions of complexity. An
application of this measure is then demonstrated to show its effectiveness as a
tool in varied situations. The experimental results show this measure has
promise as an effective tool for aiding in the evaluation of AI systems. We
propose the future use of such a complexity metric for use in computing an AI
system's intelligence.

12
The categories of this paper are: nucl-th
29
The categories of this paper are: funct-an
33
The categories of this paper are: plasm-ph
30
The categories of this paper are: q-alg
31
The categories of this paper are: ao-sci
23
The categories of this paper are: solv-int
37
The categories of this paper are: supr-con
13
The categories of this paper are: quant-ph
8
The categories of this paper are: hep-ex
11
The categories of this paper are: hep-lat
0
The categories of this paper are: hep-ph
24
The categories of this paper are: dg-ga
26
The categories of this paper are: bayes-an
5
The categories of this paper are: gr-qc
17
The categories of this paper are: q-fin
27
The categories of this paper are: comp-gas