Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Initialization Matters: Regularizing Manifold-informed Initialization
  for Neural Recommendation Systems   Proper initialization is crucial to the optimization and the generalization
of neural networks. However, most existing neural recommendation systems
initialize the user and item embeddings randomly. In this work, we propose a
new initialization scheme for user and item embeddings called Laplacian
Eigenmaps with Popularity-based Regularization for Isolated Data (LEPORID).
LEPORID endows the embeddings with information regarding multi-scale
neighborhood structures on the data manifold and performs adaptive
regularization to compensate for high embedding variance on the tail of the
data distribution. Exploiting matrix sparsity, LEPORID embeddings can be
computed efficiently. We evaluate LEPORID in a wide range of neural
recommendation models. In contrast to the recent surprising finding that the
simple K-nearest-neighbor (KNN) method often outperforms neural recommendation
systems, we show that existing neural systems initialized with LEPORID often
perform on par or better than KNN. To maximize the effects of the
initialization, we propose the Dual-Loss Residual Recommendation (DLR2)
network, which, when initialized with LEPORID, substantially outperforms both
traditional and state-of-the-art neural recommender systems.

30
The categories of this paper are: q-alg
20
The categories of this paper are: acc-phys
2
The categories of this paper are: math
28
The categories of this paper are: alg-geom
31
The categories of this paper are: ao-sci
24
The categories of this paper are: dg-ga
3
The categories of this paper are: physics
5
The categories of this paper are: gr-qc
12
The categories of this paper are: nucl-th
16
The categories of this paper are: stat
18
The categories of this paper are: econ
13
The categories of this paper are: quant-ph
37
The categories of this paper are: supr-con
17
The categories of this paper are: q-fin
27
The categories of this paper are: comp-gas
4
The categories of this paper are: cond-mat