Numerical Optimization Theoretical and Practical Aspects [Paperback]

This book starts with illustrations of the ubiquitous character of optimization, and describes numerical algorithms in a tutorial way. It covers fundamental algorithms as well as more specialized and advanced topics for unconstrained and constrained problems. This new edition of Numerical Optimization contains computational exercises in the form of case studies which help understanding optimization methods beyond their theoretical description when coming to actual implementation.

Just as in its 1st edition, this book starts with illustrations of the ubiquitous character of optimization, and describes numerical algorithms in a tutorial way. It covers fundamental algorithms as well as more specialized and advanced topics for unconstrained and constrained problems. Most of the algorithms are explained in a detailed manner, allowing straightforward implementation. Theoretical aspects of the approaches chosen are also addressed with care, often using minimal assumptions.

This new edition contains computational exercises in the form of case studies which help understanding optimization methods beyond their theoretical, description, when coming to actual implementation. Besides, the nonsmooth optimization part has been substantially reorganized and expanded.

Unconstrained Problems.- General Introduction.- Basic Methods.- Line-Searches.- Newtonian Methods.- Conjugate Gradient.- Special Methods.- A Case Study: Seismic Reection Tomography.- Nonsmooth Optimization.- to Nonsmooth Optimization.- Some Methods in Nonsmooth Optimization.- Bundle Methods. The Quest for Descent.- Applications of Nonsmooth Optimization.- Computational Exercises.- Newton's Methods in Constrained Optimization.- Background.- Local Methods for Problems with Equality Constraints.- Local Methods for Problems with Equality and InequalityConstraints.- Exact Penalization.- Globalization by Line-Search.- Quasi-Newton Versions.- Interior-Point Algorithms for lsš