Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Two-branch Recurrent Network for Isolating Deepfakes in Videos   The current spike of hyper-realistic faces artificially generated using
deepfakes calls for media forensics solutions that are tailored to video
streams and work reliably with a low false alarm rate at the video level. We
present a method for deepfake detection based on a two-branch network structure
that isolates digitally manipulated faces by learning to amplify artifacts
while suppressing the high-level face content. Unlike current methods that
extract spatial frequencies as a preprocessing step, we propose a two-branch
structure: one branch propagates the original information, while the other
branch suppresses the face content yet amplifies multi-band frequencies using a
Laplacian of Gaussian (LoG) as a bottleneck layer. To better isolate
manipulated faces, we derive a novel cost function that, unlike regular
classification, compresses the variability of natural faces and pushes away the
unrealistic facial samples in the feature space. Our two novel components show
promising results on the FaceForensics++, Celeb-DF, and Facebook's DFDC preview
benchmarks, when compared to prior work. We then offer a full, detailed
ablation study of our network architecture and cost function. Finally, although
the bar is still high to get very remarkable figures at a very low false alarm
rate, our study shows that we can achieve good video-level performance when
cross-testing in terms of video-level AUC.

20
The categories of this paper are: acc-phys
11
The categories of this paper are: hep-lat
31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
5
The categories of this paper are: gr-qc
14
The categories of this paper are: math-ph
9
The categories of this paper are: nlin
30
The categories of this paper are: q-alg
37
The categories of this paper are: supr-con
29
The categories of this paper are: funct-an
36
The categories of this paper are: cmp-lg
7
The categories of this paper are: hep-th
0
The categories of this paper are: hep-ph
15
The categories of this paper are: nucl-ex
4
The categories of this paper are: cond-mat
34
The categories of this paper are: chem-ph