Nonlinear Optimization .

Description

Optimization terminology. Convexity. First- and second-order optimality conditions for unconstrained problems. Numerical methods for unconstrained optimization: Gradient methods, Newton-type methods, conjugate gradient methods, trust-region methods. Least squares problems (linear + nonlinear). Optimality conditions for smooth constrained optimization problems (KKT theory). Lagrangian duality. Augmented Lagrangian methods. Active-set method for quadratic programming. SQP methods.