Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Consistency Training of Multi-exit Architectures for Sensor Data   Deep neural networks have become larger over the years with increasing demand
of computational resources for inference; incurring exacerbate costs and
leaving little room for deployment on devices with limited battery and other
resources for real-time applications. The multi-exit architectures are type of
deep neural network that are interleaved with several output (or exit) layers
at varying depths of the model. They provide a sound approach for improving
computational time and energy utilization of running a model through producing
predictions from early exits. In this work, we present a novel and
architecture-agnostic approach for robust training of multi-exit architectures
termed consistent exit training. The crux of the method lies in a
consistency-based objective to enforce prediction invariance over clean and
perturbed inputs. We leverage weak supervision to align model output with
consistency training and jointly optimize dual-losses in a multi-task learning
fashion over the exits in a network. Our technique enables exit layers to
generalize better when confronted with increasing uncertainty, hence, resulting
in superior quality-efficiency trade-offs. We demonstrate through extensive
evaluation on challenging learning tasks involving sensor data that our
approach allows examples to exit earlier with better detection rate and without
executing all the layers in a deep model.

19
The categories of this paper are: eess
14
The categories of this paper are: math-ph
7
The categories of this paper are: hep-th
15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys
33
The categories of this paper are: plasm-ph
36
The categories of this paper are: cmp-lg
12
The categories of this paper are: nucl-th
23
The categories of this paper are: solv-int
0
The categories of this paper are: hep-ph
3
The categories of this paper are: physics
11
The categories of this paper are: hep-lat
10
The categories of this paper are: q-bio
28
The categories of this paper are: alg-geom
2
The categories of this paper are: math
4
The categories of this paper are: cond-mat