  Recently developed reduced-order modeling techniques aim to approximate
nonlinear dynamical systems on low-dimensional manifolds learned from data.
This is an effective approach for modeling dynamics in a post-transient regime
where the effects of initial conditions and other disturbances have decayed.
However, modeling transient dynamics near an underlying manifold, as needed for
real-time control and forecasting applications, is complicated by the effects
of fast dynamics and nonnormal sensitivity mechanisms. To begin to address
these issues, we introduce a parametric class of nonlinear projections
described by constrained autoencoder neural networks in which both the manifold
and the projection fibers are learned from data. Our architecture uses
invertible activation functions and biorthogonal weight matrices to ensure that
the encoder is a left inverse of the decoder. We also introduce new
dynamics-aware cost functions that promote learning of oblique projection
fibers that account for fast dynamics and nonnormality. To demonstrate these
methods and the specific challenges they address, we provide a detailed case
study of a three-state model of vortex shedding in the wake of a bluff body
immersed in a fluid, which has a two-dimensional slow manifold that can be
computed analytically. In anticipation of future applications to
high-dimensional systems, we also propose several techniques for constructing
computationally efficient reduced-order models using our proposed nonlinear
projection framework. This includes a novel sparsity-promoting penalty for the
encoder that avoids detrimental weight matrix shrinkage via computation on the
Grassmann manifold.
