Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million
  Narrated Video Clips   Learning text-video embeddings usually requires a dataset of video clips with
manually provided captions. However, such datasets are expensive and time
consuming to create and therefore difficult to obtain on a large scale. In this
work, we propose instead to learn such embeddings from video data with readily
available natural language annotations in the form of automatically transcribed
narrations. The contributions of this work are three-fold. First, we introduce
HowTo100M: a large-scale dataset of 136 million video clips sourced from 1.22M
narrated instructional web videos depicting humans performing and describing
over 23k different visual tasks. Our data collection procedure is fast,
scalable and does not require any additional manual annotation. Second, we
demonstrate that a text-video embedding trained on this data leads to
state-of-the-art results for text-to-video retrieval and action localization on
instructional video datasets such as YouCook2 or CrossTask. Finally, we show
that this embedding transfers well to other domains: fine-tuning on generic
Youtube videos (MSR-VTT dataset) and movies (LSMDC dataset) outperforms models
trained on these datasets alone. Our dataset, code and models will be publicly
available at: www.di.ens.fr/willow/research/howto100m/.

5
The categories of this paper are: gr-qc
9
The categories of this paper are: nlin
36
The categories of this paper are: cmp-lg
4
The categories of this paper are: cond-mat
23
The categories of this paper are: solv-int
37
The categories of this paper are: supr-con
22
The categories of this paper are: chao-dyn
14
The categories of this paper are: math-ph
19
The categories of this paper are: eess
12
The categories of this paper are: nucl-th
24
The categories of this paper are: dg-ga
28
The categories of this paper are: alg-geom
17
The categories of this paper are: q-fin
26
The categories of this paper are: bayes-an
8
The categories of this paper are: hep-ex
29
The categories of this paper are: funct-an