Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Self-supervised self-supervision by combining deep learning and
  probabilistic logic   Labeling training examples at scale is a perennial challenge in machine
learning. Self-supervision methods compensate for the lack of direct
supervision by leveraging prior knowledge to automatically generate noisy
labeled examples. Deep probabilistic logic (DPL) is a unifying framework for
self-supervised learning that represents unknown labels as latent variables and
incorporates diverse self-supervision using probabilistic logic to train a deep
neural network end-to-end using variational EM. While DPL is successful at
combining pre-specified self-supervision, manually crafting self-supervision to
attain high accuracy may still be tedious and challenging. In this paper, we
propose Self-Supervised Self-Supervision (S4), which adds to DPL the capability
to learn new self-supervision automatically. Starting from an initial "seed,"
S4 iteratively uses the deep neural network to propose new self supervision.
These are either added directly (a form of structured self-training) or
verified by a human expert (as in feature-based active learning). Experiments
show that S4 is able to automatically propose accurate self-supervision and can
often nearly match the accuracy of supervised methods with a tiny fraction of
the human effort.

33
The categories of this paper are: plasm-ph
3
The categories of this paper are: physics
2
The categories of this paper are: math
19
The categories of this paper are: eess
20
The categories of this paper are: acc-phys
27
The categories of this paper are: comp-gas
15
The categories of this paper are: nucl-ex
29
The categories of this paper are: funct-an
37
The categories of this paper are: supr-con
30
The categories of this paper are: q-alg
12
The categories of this paper are: nucl-th
24
The categories of this paper are: dg-ga
6
The categories of this paper are: astro-ph
17
The categories of this paper are: q-fin
14
The categories of this paper are: math-ph
25
The categories of this paper are: patt-sol