Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Video Summarization through Reinforcement Learning with a 3D
  Spatio-Temporal U-Net   Intelligent video summarization algorithms allow to quickly convey the most
relevant information in videos through the identification of the most essential
and explanatory content while removing redundant video frames. In this paper,
we introduce the 3DST-UNet-RL framework for video summarization. A 3D
spatio-temporal U-Net is used to efficiently encode spatio-temporal information
of the input videos for downstream reinforcement learning (RL). An RL agent
learns from spatio-temporal latent scores and predicts actions for keeping or
rejecting a video frame in a video summary. We investigate if real/inflated 3D
spatio-temporal CNN features are better suited to learn representations from
videos than commonly used 2D image features. Our framework can operate in both,
a fully unsupervised mode and a supervised training mode. We analyse the impact
of prescribed summary lengths and show experimental evidence for the
effectiveness of 3DST-UNet-RL on two commonly used general video summarization
benchmarks. We also applied our method on a medical video summarization task.
The proposed video summarization method has the potential to save storage costs
of ultrasound screening videos as well as to increase efficiency when browsing
patient video data during retrospective analysis or audit without loosing
essential information

31
The categories of this paper are: ao-sci
19
The categories of this paper are: eess
26
The categories of this paper are: bayes-an
33
The categories of this paper are: plasm-ph
16
The categories of this paper are: stat
2
The categories of this paper are: math
37
The categories of this paper are: supr-con
25
The categories of this paper are: patt-sol
20
The categories of this paper are: acc-phys
32
The categories of this paper are: atom-ph
21
The categories of this paper are: adap-org
11
The categories of this paper are: hep-lat
17
The categories of this paper are: q-fin
22
The categories of this paper are: chao-dyn
6
The categories of this paper are: astro-ph
23
The categories of this paper are: solv-int