Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: HIBRIDS: Attention with Hierarchical Biases for Structure-aware Long
  Document Summarization   Document structure is critical for efficient information consumption.
However, it is challenging to encode it efficiently into the modern Transformer
architecture. In this work, we present HIBRIDS, which injects Hierarchical
Biases foR Incorporating Document Structure into the calculation of attention
scores. We further present a new task, hierarchical question-summary
generation, for summarizing salient content in the source document into a
hierarchy of questions and summaries, where each follow-up question inquires
about the content of its parent question-summary pair. We also annotate a new
dataset with 6,153 question-summary hierarchies labeled on long government
reports. Experiment results show that our model produces better
question-summary hierarchies than comparisons on both hierarchy quality and
content coverage, a finding also echoed by human judges. Additionally, our
model improves the generation of long-form summaries from lengthy government
reports and Wikipedia articles, as measured by ROUGE scores.

26
The categories of this paper are: bayes-an
2
The categories of this paper are: math
5
The categories of this paper are: gr-qc
32
The categories of this paper are: atom-ph
17
The categories of this paper are: q-fin
35
The categories of this paper are: mtrl-th
6
The categories of this paper are: astro-ph
18
The categories of this paper are: econ
4
The categories of this paper are: cond-mat
29
The categories of this paper are: funct-an
20
The categories of this paper are: acc-phys
21
The categories of this paper are: adap-org
0
The categories of this paper are: hep-ph
24
The categories of this paper are: dg-ga
7
The categories of this paper are: hep-th
11
The categories of this paper are: hep-lat