Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Look for the Change: Learning Object States and State-Modifying Actions
  from Untrimmed Web Videos   Human actions often induce changes of object states such as "cutting an
apple", "cleaning shoes" or "pouring coffee". In this paper, we seek to
temporally localize object states (e.g. "empty" and "full" cup) together with
the corresponding state-modifying actions ("pouring coffee") in long uncurated
videos with minimal supervision. The contributions of this work are threefold.
First, we develop a self-supervised model for jointly learning state-modifying
actions together with the corresponding object states from an uncurated set of
videos from the Internet. The model is self-supervised by the causal ordering
signal, i.e. initial object state $\rightarrow$ manipulating action
$\rightarrow$ end state. Second, to cope with noisy uncurated training data,
our model incorporates a noise adaptive weighting module supervised by a small
number of annotated still images, that allows to efficiently filter out
irrelevant videos during training. Third, we collect a new dataset with more
than 2600 hours of video and 34 thousand changes of object states, and manually
annotate a part of this data to validate our approach. Our results demonstrate
substantial improvements over prior work in both action and object
state-recognition in video.

31
The categories of this paper are: ao-sci
14
The categories of this paper are: math-ph
27
The categories of this paper are: comp-gas
32
The categories of this paper are: atom-ph
34
The categories of this paper are: chem-ph
13
The categories of this paper are: quant-ph
30
The categories of this paper are: q-alg
2
The categories of this paper are: math
25
The categories of this paper are: patt-sol
15
The categories of this paper are: nucl-ex
26
The categories of this paper are: bayes-an
36
The categories of this paper are: cmp-lg
10
The categories of this paper are: q-bio
0
The categories of this paper are: hep-ph
23
The categories of this paper are: solv-int
29
The categories of this paper are: funct-an