  Mathematical optimization is one of the cornerstones of modern engineering
research and practice. Yet, throughout all application domains, mathematical
optimization is, for the most part, considered to be a numerical discipline.
Optimization problems are formulated to be solved numerically with specific
algorithms running on microprocessors. An emerging alternative is to view
optimization algorithms as dynamical systems. Besides being insightful in
itself, this perspective liberates optimization methods from specific numerical
and algorithmic aspects and opens up new possibilities to endow complex
real-world systems with sophisticated self-optimizing behavior. Towards this
goal, it is necessary to understand how numerical optimization algorithms can
be converted into feedback controllers to enable robust "closed-loop
optimization". In this article, we focus on recent control designs under the
name of "feedback-based optimization" which implement optimization algorithms
directly in closed loop with physical systems. In addition to a brief overview
of selected continuous-time dynamical systems for optimization, our particular
emphasis in this survey lies on closed-loop stability as well as the robust
enforcement of physical and operational constraints in closed-loop
implementations. To bypass accessing partial model information of physical
systems, we further elaborate on fully data-driven and model-free operations.
We highlight an emerging application in autonomous reserve dispatch in power
systems, where the theory has transitioned to practice by now. We also provide
short expository reviews of pioneering applications in communication networks
and electricity grids, as well as related research streams, including extremum
seeking and pertinent methods from model predictive and process control, to
facilitate high-level comparisons with the main topic of this survey.
