  Networks have become indispensable and ubiquitous structures in many fields
to model the interactions among different entities, such as friendship in
social networks or protein interactions in biological graphs. A major challenge
is to understand the structure and dynamics of these systems. Although networks
evolve through time, most existing graph representation learning methods target
only static networks. Whereas approaches have been developed for the modeling
of dynamic networks, there is a lack of efficient continuous time dynamic graph
representation learning methods that can provide accurate network
characterization and visualization in low dimensions while explicitly
accounting for prominent network characteristics such as homophily and
transitivity. In this paper, we propose the Piecewise-Velocity Model (PiVeM)
for the representation of continuous-time dynamic networks. It learns dynamic
embeddings in which the temporal evolution of nodes is approximated by
piecewise linear interpolations based on a latent distance model with piecewise
constant node-specific velocities. The model allows for analytically tractable
expressions of the associated Poisson process likelihood with scalable
inference invariant to the number of events. We further impose a scalable
Kronecker structured Gaussian Process prior to the dynamics accounting for
community structure, temporal smoothness, and disentangled (uncorrelated)
latent embedding dimensions optimally learned to characterize the network
dynamics. We show that PiVeM can successfully represent network structure and
dynamics in ultra-low two-dimensional spaces. It outperforms relevant
state-of-art methods in downstream tasks such as link prediction. In summary,
PiVeM enables easily interpretable dynamic network visualizations and
characterizations that can further improve our understanding of the intrinsic
dynamics of time-evolving networks.
