Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Growth and Duplication of Public Source Code over Time: Provenance
  Tracking at Scale   We study the evolution of the largest known corpus of publicly available
source code, i.e., the Software Heritage archive (4B unique source code files,
1B commits capturing their development histories across 50M software projects).
On such corpus we quantify the growth rate of original, never-seen-before
source code files and commits. We find the growth rates to be exponential over
a period of more than 40 years.We then estimate the multiplication factor,
i.e., how much the same artifacts (e.g., files or commits) appear in different
contexts (e.g., commits or source code distribution places). We observe a
combinatorial explosion in the multiplication of identical source code files
across different commits.We discuss the implication of these findings for the
problem of tracking the provenance of source code artifacts (e.g., where and
when a given source code file or commit has been observed in the wild) for the
entire body of publicly available source code. To that end we benchmark
different data models for capturing software provenance information at this
scale and growth rate. We identify a viable solution that is deployable on
commodity hardware and appears to be maintainable for the foreseeable future.

33
The categories of this paper are: plasm-ph
13
The categories of this paper are: quant-ph
18
The categories of this paper are: econ
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
3
The categories of this paper are: physics
17
The categories of this paper are: q-fin
29
The categories of this paper are: funct-an
21
The categories of this paper are: adap-org
31
The categories of this paper are: ao-sci
32
The categories of this paper are: atom-ph
10
The categories of this paper are: q-bio
36
The categories of this paper are: cmp-lg
9
The categories of this paper are: nlin
19
The categories of this paper are: eess
24
The categories of this paper are: dg-ga