Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Using Navigational Information to Learn Visual Representations   Children learn to build a visual representation of the world from
unsupervised exploration and we hypothesize that a key part of this learning
ability is the use of self-generated navigational information as a similarity
label to drive a learning objective for self-supervised learning. The goal of
this work is to exploit navigational information in a visual environment to
provide performance in training that exceeds the state-of-the-art
self-supervised training. Here, we show that using spatial and temporal
information in the pretraining stage of contrastive learning can improve the
performance of downstream classification relative to conventional contrastive
learning approaches that use instance discrimination to discriminate between
two alterations of the same image or two different images. We designed a
pipeline to generate egocentric-vision images from a photorealistic ray-tracing
environment (ThreeDWorld) and record relevant navigational information for each
image. Modifying the Momentum Contrast (MoCo) model, we introduced spatial and
temporal information to evaluate the similarity of two views in the pretraining
stage instead of instance discrimination. This work reveals the effectiveness
and efficiency of contextual information for improving representation learning.
The work informs our understanding of the means by which children might learn
to see the world without external supervision.

8
The categories of this paper are: hep-ex
27
The categories of this paper are: comp-gas
13
The categories of this paper are: quant-ph
33
The categories of this paper are: plasm-ph
17
The categories of this paper are: q-fin
5
The categories of this paper are: gr-qc
11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
24
The categories of this paper are: dg-ga
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
19
The categories of this paper are: eess
32
The categories of this paper are: atom-ph
7
The categories of this paper are: hep-th
23
The categories of this paper are: solv-int
22
The categories of this paper are: chao-dyn