Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: How to Evaluate Your Dialogue Models: A Review of Approaches   Evaluating the quality of a dialogue system is an understudied problem. The
recent evolution of evaluation method motivated this survey, in which an
explicit and comprehensive analysis of the existing methods is sought. We are
first to divide the evaluation methods into three classes, i.e., automatic
evaluation, human-involved evaluation and user simulator based evaluation.
Then, each class is covered with main features and the related evaluation
metrics. The existence of benchmarks, suitable for the evaluation of dialogue
techniques are also discussed in detail. Finally, some open issues are pointed
out to bring the evaluation method into a new frontier.

29
The categories of this paper are: funct-an
19
The categories of this paper are: eess
5
The categories of this paper are: gr-qc
30
The categories of this paper are: q-alg
8
The categories of this paper are: hep-ex
4
The categories of this paper are: cond-mat
25
The categories of this paper are: patt-sol
7
The categories of this paper are: hep-th
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
11
The categories of this paper are: hep-lat
33
The categories of this paper are: plasm-ph
10
The categories of this paper are: q-bio
0
The categories of this paper are: hep-ph
13
The categories of this paper are: quant-ph
3
The categories of this paper are: physics