Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning by Teaching, with Application to Neural Architecture Search   In human learning, an effective skill in improving learning outcomes is
learning by teaching: a learner deepens his/her understanding of a topic by
teaching this topic to others. In this paper, we aim to borrow this
teaching-driven learning methodology from humans and leverage it to train more
performant machine learning models, by proposing a novel ML framework referred
to as learning by teaching (LBT). In the LBT framework, a teacher model
improves itself by teaching a student model to learn well. Specifically, the
teacher creates a pseudo-labeled dataset and uses it to train a student model.
Based on how the student performs on a validation dataset, the teacher
re-learns its model and re-teaches the student until the student achieves great
validation performance. Our framework is based on three-level optimization
which contains three stages: teacher learns; teacher teaches student; teacher
re-learns based on how well the student performs. A simple but efficient
algorithm is developed to solve the three-level optimization problem. We apply
LBT to search neural architectures on CIFAR-10, CIFAR-100, and ImageNet. The
efficacy of our method is demonstrated in various experiments.

13
The categories of this paper are: quant-ph
31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
20
The categories of this paper are: acc-phys
3
The categories of this paper are: physics
12
The categories of this paper are: nucl-th
4
The categories of this paper are: cond-mat
17
The categories of this paper are: q-fin
18
The categories of this paper are: econ
36
The categories of this paper are: cmp-lg
33
The categories of this paper are: plasm-ph
34
The categories of this paper are: chem-ph
25
The categories of this paper are: patt-sol
30
The categories of this paper are: q-alg
7
The categories of this paper are: hep-th
23
The categories of this paper are: solv-int