Gradient descent
Solution of a linear system

The line search minimization, finding the locally optimal step size η {\displaystyle \eta } on every iteration, can be performed analytically for quadratic functions, and explicit formulas for the locally optimal η {\displaystyle \eta } are known.
change_case:english_capital, detectable_format:number_highlighted_sections[5]