Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Kernel-convoluted Deep Neural Networks with Data Augmentation   The Mixup method (Zhang et al. 2018), which uses linearly interpolated data,
has emerged as an effective data augmentation tool to improve generalization
performance and the robustness to adversarial examples. The motivation is to
curtail undesirable oscillations by its implicit model constraint to behave
linearly at in-between observed data points and promote smoothness. In this
work, we formally investigate this premise, propose a way to explicitly impose
smoothness constraints, and extend it to incorporate with implicit model
constraints. First, we derive a new function class composed of
kernel-convoluted models (KCM) where the smoothness constraint is directly
imposed by locally averaging the original functions with a kernel function.
Second, we propose to incorporate the Mixup method into KCM to expand the
domains of smoothness. In both cases of KCM and the KCM adapted with the Mixup,
we provide risk analysis, respectively, under some conditions for kernels. We
show that the upper bound of the excess risk is not slower than that of the
original function class. The upper bound of the KCM with the Mixup remains
dominated by that of the KCM if the perturbation of the Mixup vanishes faster
than \(O(n^{-1/2})\) where \(n\) is a sample size. Using CIFAR-10 and CIFAR-100
datasets, our experiments demonstrate that the KCM with the Mixup outperforms
the Mixup method in terms of generalization and robustness to adversarial
examples.

35
The categories of this paper are: mtrl-th
20
The categories of this paper are: acc-phys
16
The categories of this paper are: stat
10
The categories of this paper are: q-bio
14
The categories of this paper are: math-ph
3
The categories of this paper are: physics
2
The categories of this paper are: math
29
The categories of this paper are: funct-an
4
The categories of this paper are: cond-mat
36
The categories of this paper are: cmp-lg
37
The categories of this paper are: supr-con
19
The categories of this paper are: eess
27
The categories of this paper are: comp-gas
18
The categories of this paper are: econ
26
The categories of this paper are: bayes-an
17
The categories of this paper are: q-fin