Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: ViSiL: Fine-grained Spatio-Temporal Video Similarity Learning   In this paper we introduce ViSiL, a Video Similarity Learning architecture
that considers fine-grained Spatio-Temporal relations between pairs of videos
-- such relations are typically lost in previous video retrieval approaches
that embed the whole frame or even the whole video into a vector descriptor
before the similarity estimation. By contrast, our Convolutional Neural Network
(CNN)-based approach is trained to calculate video-to-video similarity from
refined frame-to-frame similarity matrices, so as to consider both intra- and
inter-frame relations. In the proposed method, pairwise frame similarity is
estimated by applying Tensor Dot (TD) followed by Chamfer Similarity (CS) on
regional CNN frame features - this avoids feature aggregation before the
similarity calculation between frames. Subsequently, the similarity matrix
between all video frames is fed to a four-layer CNN, and then summarized using
Chamfer Similarity (CS) into a video-to-video similarity score -- this avoids
feature aggregation before the similarity calculation between videos and
captures the temporal similarity patterns between matching frame sequences. We
train the proposed network using a triplet loss scheme and evaluate it on five
public benchmark datasets on four different video retrieval problems where we
demonstrate large improvements in comparison to the state of the art. The
implementation of ViSiL is publicly available.

31
The categories of this paper are: ao-sci
0
The categories of this paper are: hep-ph
30
The categories of this paper are: q-alg
24
The categories of this paper are: dg-ga
26
The categories of this paper are: bayes-an
27
The categories of this paper are: comp-gas
21
The categories of this paper are: adap-org
15
The categories of this paper are: nucl-ex
9
The categories of this paper are: nlin
37
The categories of this paper are: supr-con
7
The categories of this paper are: hep-th
14
The categories of this paper are: math-ph
32
The categories of this paper are: atom-ph
11
The categories of this paper are: hep-lat
34
The categories of this paper are: chem-ph
6
The categories of this paper are: astro-ph