Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Cross-Modal Food Retrieval: Learning a Joint Embedding of Food Images
  and Recipes with Semantic Consistency and Attention Mechanism   Food retrieval is an important task to perform analysis of food-related
information, where we are interested in retrieving relevant information about
the queried food item such as ingredients, cooking instructions, etc. In this
paper, we investigate cross-modal retrieval between food images and cooking
recipes. The goal is to learn an embedding of images and recipes in a common
feature space, such that the corresponding image-recipe embeddings lie close to
one another. Two major challenges in addressing this problem are 1) large
intra-variance and small inter-variance across cross-modal food data; and 2)
difficulties in obtaining discriminative recipe representations. To address
these two problems, we propose Semantic-Consistent and Attention-based Networks
(SCAN), which regularize the embeddings of the two modalities through aligning
output semantic probabilities. Besides, we exploit a self-attention mechanism
to improve the embedding of recipes. We evaluate the performance of the
proposed method on the large-scale Recipe1M dataset, and show that we can
outperform several state-of-the-art cross-modal retrieval strategies for food
images and cooking recipes by a significant margin.

17
The categories of this paper are: q-fin
23
The categories of this paper are: solv-int
27
The categories of this paper are: comp-gas
26
The categories of this paper are: bayes-an
31
The categories of this paper are: ao-sci
21
The categories of this paper are: adap-org
12
The categories of this paper are: nucl-th
3
The categories of this paper are: physics
8
The categories of this paper are: hep-ex
36
The categories of this paper are: cmp-lg
0
The categories of this paper are: hep-ph
33
The categories of this paper are: plasm-ph
34
The categories of this paper are: chem-ph
30
The categories of this paper are: q-alg
19
The categories of this paper are: eess
35
The categories of this paper are: mtrl-th