  Principal component analysis (PCA) is a workhorse of modern data science.
Practitioners typically perform PCA assuming the data conforms to Euclidean
geometry. However, for specific data types, such as hierarchical data, other
geometrical spaces may be more appropriate. We study PCA in space forms; that
is, those with constant positive (spherical) and negative (hyperbolic)
curvatures, in addition to zero-curvature (Euclidean) spaces. At any point on a
Riemannian manifold, one can define a Riemannian affine subspace based on a set
of tangent vectors and use invertible maps to project tangent vectors to the
manifold and vice versa. Finding a low-dimensional Riemannian affine subspace
for a set of points in a space form amounts to dimensionality reduction
because, as we show, any such affine subspace is isometric to a space form of
the same dimension and curvature. To find principal components, we seek a
(Riemannian) affine subspace that best represents a set of manifold-valued data
points with the minimum average cost of projecting data points onto the affine
subspace. We propose specific cost functions that bring about two major
benefits: (1) the affine subspace can be estimated by solving an eigenequation
-- similar to that of Euclidean PCA, and (2) optimal affine subspaces of
different dimensions form a nested set. These properties provide advances over
existing methods which are mostly iterative algorithms with slow convergence
and weaker theoretical guarantees. Specifically for hyperbolic PCA, the
associated eigenequation operates in the Lorentzian space, endowed with an
indefinite inner product; we thus establish a connection between Lorentzian and
Euclidean eigenequations. We evaluate the proposed space form PCA on data sets
simulated in spherical and hyperbolic spaces and show that it outperforms
alternative methods in convergence speed or accuracy, often both.
