Introduction: Overview of Unconstrained Optimization

Unconstrained optimization consists of minimizing a function which depends on a number of real variables without any restrictions on the values of these variables. When the number of variables is large, this problem becomes quite challenging. The most important gradient methods for solving unconstrained optimization problems are described in this chapter. These methods are iterative.