Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Collaborative Unsupervised Visual Representation Learning from
  Decentralized Data   Unsupervised representation learning has achieved outstanding performances
using centralized data available on the Internet. However, the increasing
awareness of privacy protection limits sharing of decentralized unlabeled image
data that grows explosively in multiple parties (e.g., mobile phones and
cameras). As such, a natural problem is how to leverage these data to learn
visual representations for downstream tasks while preserving data privacy. To
address this problem, we propose a novel federated unsupervised learning
framework, FedU. In this framework, each party trains models from unlabeled
data independently using contrastive learning with an online network and a
target network. Then, a central server aggregates trained models and updates
clients' models with the aggregated model. It preserves data privacy as each
party only has access to its raw data. Decentralized data among multiple
parties are normally non-independent and identically distributed (non-IID),
leading to performance degradation. To tackle this challenge, we propose two
simple but effective methods: 1) We design the communication protocol to upload
only the encoders of online networks for server aggregation and update them
with the aggregated encoder; 2) We introduce a new module to dynamically decide
how to update predictors based on the divergence caused by non-IID. The
predictor is the other component of the online network. Extensive experiments
and ablations demonstrate the effectiveness and significance of FedU. It
outperforms training with only one party by over 5% and other methods by over
14% in linear and semi-supervised evaluation on non-IID data.

3
The categories of this paper are: physics
35
The categories of this paper are: mtrl-th
5
The categories of this paper are: gr-qc
22
The categories of this paper are: chao-dyn
17
The categories of this paper are: q-fin
10
The categories of this paper are: q-bio
4
The categories of this paper are: cond-mat
36
The categories of this paper are: cmp-lg
28
The categories of this paper are: alg-geom
34
The categories of this paper are: chem-ph
20
The categories of this paper are: acc-phys
21
The categories of this paper are: adap-org
26
The categories of this paper are: bayes-an
8
The categories of this paper are: hep-ex
12
The categories of this paper are: nucl-th
6
The categories of this paper are: astro-ph