Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Exposing Semantic Segmentation Failures via Maximum Discrepancy
  Competition   Semantic segmentation is an extensively studied task in computer vision, with
numerous methods proposed every year. Thanks to the advent of deep learning in
semantic segmentation, the performance on existing benchmarks is close to
saturation. A natural question then arises: Does the superior performance on
the closed (and frequently re-used) test sets transfer to the open visual world
with unconstrained variations? In this paper, we take steps toward answering
the question by exposing failures of existing semantic segmentation methods in
the open visual world under the constraint of very limited human labeling
effort. Inspired by previous research on model falsification, we start from an
arbitrarily large image set, and automatically sample a small image set by
MAximizing the Discrepancy (MAD) between two segmentation methods. The selected
images have the greatest potential in falsifying either (or both) of the two
methods. We also explicitly enforce several conditions to diversify the exposed
failures, corresponding to different underlying root causes. A segmentation
method, whose failures are more difficult to be exposed in the MAD competition,
is considered better. We conduct a thorough MAD diagnosis of ten PASCAL VOC
semantic segmentation algorithms. With detailed analysis of experimental
results, we point out strengths and weaknesses of the competing algorithms, as
well as potential research directions for further advancement in semantic
segmentation. The codes are publicly available at
\url{https://github.com/QTJiebin/MAD_Segmentation}.

20
The categories of this paper are: acc-phys
34
The categories of this paper are: chem-ph
16
The categories of this paper are: stat
19
The categories of this paper are: eess
7
The categories of this paper are: hep-th
21
The categories of this paper are: adap-org
12
The categories of this paper are: nucl-th
17
The categories of this paper are: q-fin
29
The categories of this paper are: funct-an
18
The categories of this paper are: econ
25
The categories of this paper are: patt-sol
28
The categories of this paper are: alg-geom
2
The categories of this paper are: math
6
The categories of this paper are: astro-ph
13
The categories of this paper are: quant-ph
5
The categories of this paper are: gr-qc