Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning Cross-Domain Correspondence for Control with Dynamics
  Cycle-Consistency   At the heart of many robotics problems is the challenge of learning
correspondences across domains. For instance, imitation learning requires
obtaining correspondence between humans and robots; sim-to-real requires
correspondence between physics simulators and the real world; transfer learning
requires correspondences between different robotics environments. This paper
aims to learn correspondence across domains differing in representation (vision
vs. internal state), physics parameters (mass and friction), and morphology
(number of limbs). Importantly, correspondences are learned using unpaired and
randomly collected data from the two domains. We propose \textit{dynamics
cycles} that align dynamic robot behavior across two domains using a
cycle-consistency constraint. Once this correspondence is found, we can
directly transfer the policy trained on one domain to the other, without
needing any additional fine-tuning on the second domain. We perform experiments
across a variety of problem domains, both in simulation and on real robot. Our
framework is able to align uncalibrated monocular video of a real robot arm to
dynamic state-action trajectories of a simulated arm without paired data. Video
demonstrations of our results are available at:
https://sjtuzq.github.io/cycle_dynamics.html .

30
The categories of this paper are: q-alg
21
The categories of this paper are: adap-org
6
The categories of this paper are: astro-ph
29
The categories of this paper are: funct-an
9
The categories of this paper are: nlin
23
The categories of this paper are: solv-int
34
The categories of this paper are: chem-ph
3
The categories of this paper are: physics
8
The categories of this paper are: hep-ex
17
The categories of this paper are: q-fin
20
The categories of this paper are: acc-phys
33
The categories of this paper are: plasm-ph
7
The categories of this paper are: hep-th
31
The categories of this paper are: ao-sci
27
The categories of this paper are: comp-gas
28
The categories of this paper are: alg-geom