Convex Optimization Algorithms

by Dimitri P. Bertsekas

ISBN: 1-886529-28-0, 978-1-886529-28-1
Publication: February, 2015, 576 pages, hardcover
Price: $89.00

Contents and Preface, Chapters 1 and 2, Course Material from MIT OCW

Ordering, Home


This book aims at an up-to-date and accessible development of algorithms for solving convex optimization problems. The book covers almost all the major classes of convex optimization algorithms. Principal among these are gradient, subgradient, polyhedral approximation, proximal, and interior point methods. Most of these methods rely on convexity (but not necessarily differentiability) in the cost and constraint functions, and are often connected in various ways to duality. The book contains numerous examples describing in detail applications to specially structured problems.

The book complements our Convex Optimization Theory (Athena Scientific, 2009) book, but can be read independently. The latter book focuses on convexity theory and optimization duality, while the present book focuses on algorithmic issues. The two books share mathematical prerequisites, notation, and style, and together cover the entire finite-dimensional convex optimization field. Both books rely on rigorous mathematical analysis, but also aim at an intuitive exposition that makes use of visualization where possible. This is facilitated by the extensive use of analytical and algorithmic concepts of duality, which by nature lend themselves to geometrical interpretation.

The book differs from our Nonlinear Programming (Athena Scientific, 2016) in that it deals primarily with convex, possibly nondifferentiable, optimization problems and relies on convex analysis. By contrast the nonlinear programming book focuses primarily on analytical and computational methods for possibly nonconvex differentiable problems, and relies mostly on calculus and variational analysis.

The book may be used as a text for a convex optimization course with a focus on algorithms; the author has taught several variants of such a course at MIT and elsewhere over the last fifteen years. It may also be used as a supplementary source for nonlinear programming classes, and as an algorithmic foundation for classes focused on convex optimization models. It is an excellent supplement to several of our books: Convex Optimization Theory (Athena Scientific, 2009), Nonlinear Programming (Athena Scientific, 2016), Network Optimization (Athena Scientific, 1998), Introduction to Linear Optimization (Athena Scientific, 1997), and Network Flows and Monotropic Optimization (Athena Scientific, 1998).

Among its features, the book:

Dimitri P. Bertsekas is McAfee Professor of Engineering at the Massachusetts Institute of Technology and a member of the prestigious United States National Academy of Engineering. He is the recipient of the 2001 A. R. Raggazini ACC education award, the 2009 INFORMS expository writing award, the 2014 Kachiyan Prize, and the 2014 AACC Bellman Heritage Award.

Supplementary Material:

The material listed below can be freely downloaded, reproduced, and distributed. The following sets of slides reflect an increasing emphasis on algorithms over time.

[Return to Athena Scientific Homepage]