Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Managing the Complexity of Processing Financial Data at Scale -- an
  Experience Report   Financial markets are extremely data-driven and regulated. Participants rely
on notifications about significant events and background information that meet
their requirements regarding timeliness, accuracy, and completeness. As one of
Europe's leading providers of financial data and regulatory solutions vwd
processes a daily average of 18 billion notifications from 500+ data sources
for 30 million symbols. Our large-scale geo-distributed systems handle daily
peak rates of 1+ million notifications/sec. In this paper we give practical
insights about the different types of complexity we face regarding the data we
process, the systems we operate, and the regulatory constraints we must comply
with. We describe the volume, variety, velocity, and veracity of the data we
process, the infrastructure we operate, and the architecture we apply. We
illustrate the load patterns created by trading and how the markets' attention
to the Brexit vote and similar events stressed our systems.

0
The categories of this paper are: hep-ph
8
The categories of this paper are: hep-ex
26
The categories of this paper are: bayes-an
16
The categories of this paper are: stat
36
The categories of this paper are: cmp-lg
30
The categories of this paper are: q-alg
10
The categories of this paper are: q-bio
7
The categories of this paper are: hep-th
18
The categories of this paper are: econ
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
29
The categories of this paper are: funct-an
11
The categories of this paper are: hep-lat
6
The categories of this paper are: astro-ph
13
The categories of this paper are: quant-ph
25
The categories of this paper are: patt-sol