Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: How Trustworthy are Performance Evaluations for Basic Vision Tasks?   This paper examines performance evaluation criteria for basic vision tasks
involving sets of objects namely, object detection,instance-level segmentation
and multi-object tracking. The rankings of algorithms by an existing criterion
can fluctuate with different choices of parameters,e.g.Intersection over Union
(IoU) threshold, making their evaluations unreliable. More importantly, there
is no means to verify whether we can trust the evaluations of a criterion. This
work suggests a notion of trustworthiness for performance criteria, which
requires (i) robustness to parameters for reliability, (ii) contextual
meaningfulness in sanity tests, and (iii) consistency with mathematical
requirements such as the metric properties. We observe that these requirements
were overlooked by many widely-used criteria, and explore alternative criteria
using metrics for sets of shapes. We also assess all these criteria based on
the suggested requirements for trustworthiness.

31
The categories of this paper are: ao-sci
0
The categories of this paper are: hep-ph
4
The categories of this paper are: cond-mat
14
The categories of this paper are: math-ph
16
The categories of this paper are: stat
7
The categories of this paper are: hep-th
24
The categories of this paper are: dg-ga
27
The categories of this paper are: comp-gas
19
The categories of this paper are: eess
35
The categories of this paper are: mtrl-th
8
The categories of this paper are: hep-ex
33
The categories of this paper are: plasm-ph
10
The categories of this paper are: q-bio
9
The categories of this paper are: nlin
20
The categories of this paper are: acc-phys
11
The categories of this paper are: hep-lat