Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Batched matrix operations on distributed GPUs with application in
  theoretical physics   One of the most important and commonly used operations in many linear algebra
functions is matrix-matrix multiplication (GEMM), which is also a key component
in obtaining high performance of many scientific codes. It is a computationally
intensive function requiring $O(n^3)$ operations, and its high computational
intensity makes it well-suited to be significantly accelerated with GPUs.
Today, many research problems require solving a very large number of relatively
small GEMM operations that cannot utilise the entire GPU. To overcome this
bottleneck, special functions have been developed that pack several GEMM
operations into one and then compute them simultaneously on a GPU, which is
called a batch operation. In this research work, we have proposed a different
approach based on linking multiple GEMM operations to MPI ranks and then
binding multiple MPI ranks to a single GPU. To increase GPU utilisation, more
MPI ranks (i.e. GEMM operations) are added. We implement and test this approach
in the field of theoretical physics to compute entanglement properties through
simulated annealing Monte Carlo simulation of quantum spin chains. For the
specific use case, we were able to simulate a much larger spin system and
achieve a speed-up of up to $35\times$ compared to the parallel CPU-only
version.

14
The categories of this paper are: math-ph
9
The categories of this paper are: nlin
0
The categories of this paper are: hep-ph
16
The categories of this paper are: stat
3
The categories of this paper are: physics
26
The categories of this paper are: bayes-an
32
The categories of this paper are: atom-ph
15
The categories of this paper are: nucl-ex
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
28
The categories of this paper are: alg-geom
27
The categories of this paper are: comp-gas
2
The categories of this paper are: math
13
The categories of this paper are: quant-ph
10
The categories of this paper are: q-bio
11
The categories of this paper are: hep-lat