  Recently CNN-based RGB-D salient object detection (SOD) has obtained
significant improvement on detection accuracy. However, existing models often
fail to perform well in terms of efficiency and accuracy simultaneously. This
hinders their potential applications on mobile devices as well as many
real-world problems. To bridge the accuracy gap between lightweight and large
models for RGB-D SOD, in this paper, an efficient module that can greatly
improve the accuracy but adds little computation is proposed. Inspired by the
fact that depth quality is a key factor influencing the accuracy, we propose an
efficient depth quality-inspired feature manipulation (DQFM) process, which can
dynamically filter depth features according to depth quality. The proposed DQFM
resorts to the alignment of low-level RGB and depth features, as well as
holistic attention of the depth stream to explicitly control and enhance
cross-modal fusion. We embed DQFM to obtain an efficient lightweight RGB-D SOD
model called DFM-Net, where we in addition design a tailored depth backbone and
a two-stage decoder as basic parts. Extensive experimental results on nine
RGB-D datasets demonstrate that our DFM-Net outperforms recent efficient
models, running at about 20 FPS on CPU with only 8.5Mb model size, and
meanwhile being 2.9/2.4 times faster and 6.7/3.1 times smaller than the latest
best models A2dele and MobileSal. It also maintains state-of-the-art accuracy
when even compared to non-efficient models. Interestingly, further statistics
and analyses verify the ability of DQFM in distinguishing depth maps of various
qualities without any quality labels. Last but not least, we further apply
DFM-Net to deal with video SOD (VSOD), achieving comparable performance against
recent efficient models while being 3/2.3 times faster/smaller than the prior
best in this field. Our code is available at https://github.com/zwbx/DFM-Net.
