Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: End-to-End Learning of Semantic Grasping   We consider the task of semantic robotic grasping, in which a robot picks up
an object of a user-specified class using only monocular images. Inspired by
the two-stream hypothesis of visual reasoning, we present a semantic grasping
framework that learns object detection, classification, and grasp planning in
an end-to-end fashion. A "ventral stream" recognizes object class while a
"dorsal stream" simultaneously interprets the geometric relationships necessary
to execute successful grasps. We leverage the autonomous data collection
capabilities of robots to obtain a large self-supervised dataset for training
the dorsal stream, and use semi-supervised label propagation to train the
ventral stream with only a modest amount of human supervision. We
experimentally show that our approach improves upon grasping systems whose
components are not learned end-to-end, including a baseline method that uses
bounding box detection. Furthermore, we show that jointly training our model
with auxiliary data consisting of non-semantic grasping data, as well as
semantically labeled images without grasp actions, has the potential to
substantially improve semantic grasping performance.

33
The categories of this paper are: plasm-ph
11
The categories of this paper are: hep-lat
35
The categories of this paper are: mtrl-th
25
The categories of this paper are: patt-sol
13
The categories of this paper are: quant-ph
19
The categories of this paper are: eess
31
The categories of this paper are: ao-sci
15
The categories of this paper are: nucl-ex
6
The categories of this paper are: astro-ph
29
The categories of this paper are: funct-an
9
The categories of this paper are: nlin
2
The categories of this paper are: math
8
The categories of this paper are: hep-ex
28
The categories of this paper are: alg-geom
26
The categories of this paper are: bayes-an
17
The categories of this paper are: q-fin