Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Trade-offs in Top-k Classification Accuracies on Losses for Deep
  Learning   This paper presents an experimental analysis about trade-offs in top-k
classification accuracies on losses for deep leaning and proposal of a novel
top-k loss. Commonly-used cross entropy (CE) is not guaranteed to optimize
top-k prediction without infinite training data and model complexities. The
objective is to clarify when CE sacrifices top-k accuracies to optimize top-1
prediction, and to design loss that improve top-k accuracy under such
conditions. Our novel loss is basically CE modified by grouping temporal top-k
classes as a single class. To obtain a robust decision boundary, we introduce
an adaptive transition from normal CE to our loss, and thus call it top-k
transition loss. It is demonstrated that CE is not always the best choice to
learn top-k prediction in our experiments. First, we explore trade-offs between
top-1 and top-k (=2) accuracies on synthetic datasets, and find a failure of CE
in optimizing top-k prediction when we have complex data distribution for a
given model to represent optimal top-1 prediction. Second, we compare top-k
accuracies on CIFAR-100 dataset targeting top-5 prediction in deep learning.
While CE performs the best in top-1 accuracy, in top-5 accuracy our loss
performs better than CE except using one experimental setup. Moreover, our loss
has been found to provide better top-k accuracies compared to CE at k larger
than 10. As a result, a ResNet18 model trained with our loss reaches 99 %
accuracy with k=25 candidates, which is a smaller candidate number than that of
CE by 8.

0
The categories of this paper are: hep-ph
37
The categories of this paper are: supr-con
15
The categories of this paper are: nucl-ex
30
The categories of this paper are: q-alg
8
The categories of this paper are: hep-ex
32
The categories of this paper are: atom-ph
13
The categories of this paper are: quant-ph
14
The categories of this paper are: math-ph
2
The categories of this paper are: math
23
The categories of this paper are: solv-int
19
The categories of this paper are: eess
33
The categories of this paper are: plasm-ph
21
The categories of this paper are: adap-org
5
The categories of this paper are: gr-qc
27
The categories of this paper are: comp-gas
9
The categories of this paper are: nlin