Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Small Batch Sizes Improve Training of Low-Resource Neural MT   We study the role of an essential hyper-parameter that governs the training
of Transformers for neural machine translation in a low-resource setting: the
batch size. Using theoretical insights and experimental evidence, we argue
against the widespread belief that batch size should be set as large as allowed
by the memory of the GPUs. We show that in a low-resource setting, a smaller
batch size leads to higher scores in a shorter training time, and argue that
this is due to better regularization of the gradients during training.

0
The categories of this paper are: hep-ph
7
The categories of this paper are: hep-th
24
The categories of this paper are: dg-ga
26
The categories of this paper are: bayes-an
3
The categories of this paper are: physics
36
The categories of this paper are: cmp-lg
6
The categories of this paper are: astro-ph
9
The categories of this paper are: nlin
5
The categories of this paper are: gr-qc
30
The categories of this paper are: q-alg
28
The categories of this paper are: alg-geom
29
The categories of this paper are: funct-an
4
The categories of this paper are: cond-mat
2
The categories of this paper are: math
22
The categories of this paper are: chao-dyn
15
The categories of this paper are: nucl-ex