Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Consistent Depth Prediction under Various Illuminations using Dilated
  Cross Attention   In this paper, we aim to solve the problem of consistent depth prediction in
complex scenes under various illumination conditions. The existing indoor
datasets based on RGB-D sensors or virtual rendering have two critical
limitations - sparse depth maps (NYU Depth V2) and non-realistic illumination
(SUN CG, SceneNet RGB-D). We propose to use internet 3D indoor scenes and
manually tune their illuminations to render photo-realistic RGB photos and
their corresponding depth and BRDF maps, obtaining a new indoor depth dataset
called Vari dataset. We propose a simple convolutional block named DCA by
applying depthwise separable dilated convolution on encoded features to process
global information and reduce parameters. We perform cross attention on these
dilated features to retain the consistency of depth prediction under different
illuminations. Our method is evaluated by comparing it with current
state-of-the-art methods on Vari dataset and a significant improvement is
observed in our experiments. We also conduct the ablation study, finetune our
model on NYU Depth V2 and also evaluate on real-world data to further validate
the effectiveness of our DCA block. The code, pre-trained weights and Vari
dataset are open-sourced.

0
The categories of this paper are: hep-ph
24
The categories of this paper are: dg-ga
30
The categories of this paper are: q-alg
7
The categories of this paper are: hep-th
26
The categories of this paper are: bayes-an
9
The categories of this paper are: nlin
6
The categories of this paper are: astro-ph
37
The categories of this paper are: supr-con
23
The categories of this paper are: solv-int
20
The categories of this paper are: acc-phys
4
The categories of this paper are: cond-mat
31
The categories of this paper are: ao-sci
29
The categories of this paper are: funct-an
18
The categories of this paper are: econ
17
The categories of this paper are: q-fin
27
The categories of this paper are: comp-gas