  In this paper we discuss the performance of solvers for low-rank linear
systems in the tensor-train format, also known as matrix-product states (MPS)
in physics. We focus on today's many-core CPU systems and the interplay of the
performance and the required linear algebra operations in this setting.
Specifically, we consider the tensor-train GMRES method, the modified
alternating linear scheme (MALS) and the alternating minimal energy (AMEn).
Based on the example of a simple non-symmetric system from discretizing a
multidimensional convection-diffusion equation in, e.g., $50^{10}$ grid points,
we illustrate the computational complexity of the three methods. This shows
that the projection to smaller sub-problems reduces the required number of
floating point operations by orders of magnitude: between GMRES and MALS, and
again between MALS and AMEn. All three methods require similar underlying
linear algebra operations (building blocks). We suggest several building block
improvements regarding orthogonalization steps, singular value decompositions,
and tensor contractions. In addition, we propose a simple generic
preconditioner in the tensor-train format based on a rank-1 approximation of
the operator. Combining all optimizations, we obtain roughly a 5x speedup over
the reference implementation for the fastest method (AMEn) on a current
multi-core CPU.
