Nonlinear Optimization

Nonlinear Optimization

by Andrzej Ruszczynski, Andrzej Ruszczynski
5.0 1
Pub. Date:
Princeton University Press
Select a Purchase Option (New Edition)
  • purchase options
    $91.87 $105.00 Save 13% Current price is $91.87, Original price is $105. You Save 13%.
  • purchase options


Nonlinear Optimization

Optimization is one of the most important areas of modern applied mathematics, with applications in fields from engineering and economics to finance, statistics, management science, and medicine. While many books have addressed its various aspects, Nonlinear Optimization is the first comprehensive treatment that will allow graduate students and researchers to understand its modern ideas, principles, and methods within a reasonable time, but without sacrificing mathematical precision. Andrzej Ruszczynski, a leading expert in the optimization of nonlinear stochastic systems, integrates the theory and the methods of nonlinear optimization in a unified, clear, and mathematically rigorous fashion, with detailed and easy-to-follow proofs illustrated by numerous examples and figures.

The book covers convex analysis, the theory of optimality conditions, duality theory, and numerical methods for solving unconstrained and constrained optimization problems. It addresses not only classical material but also modern topics such as optimality conditions and numerical methods for problems involving nondifferentiable functions, semidefinite programming, metric regularity and stability theory of set-constrained systems, and sensitivity analysis of optimization problems.

Based on a decade's worth of notes the author compiled in successfully teaching the subject, this book will help readers to understand the mathematical foundations of the modern theory and methods of nonlinear optimization and to analyze new problems, develop optimality theory for them, and choose or construct numerical solution methods. It is a must for anyone seriously interested in optimization.

Product Details

ISBN-13: 9780691119151
Publisher: Princeton University Press
Publication date: 01/02/2006
Edition description: New Edition
Pages: 464
Product dimensions: 6.00(w) x 9.25(h) x 1.40(d)

Table of Contents

Preface xi

Chapter 1. Introduction 1


Chapter 2. Elements of Convex Analysis 17

2.1 Convex Sets 17

2.2 Cones 25

2.3 Extreme Points 39

2.4 Convex Functions 44

2.5 Subdifferential Calculus 57

2.6 Conjugate Duality 75

Chapter 3. Optimality Conditions 88

3.1 Unconstrained Minima of Differentiable Functions 88

3.2 Unconstrained Minima of Convex Functions 92

3.3 Tangent Cones 98

3.4 Optimality Conditions for Smooth Problems 113

3.5 Optimality Conditions for Convex Problems 125

3.6 Optimality Conditions for Smooth-Convex Problems 133

3.7 Second Order Optimality Conditions 139

3.8 Sensitivity 150

Chapter 4. Lagrangian Duality 160

4.1 The Dual Problem 160

4.2 Duality Relations 166

4.3 Conic Programming 175

4.4 Decomposition 180

4.5 Convex Relaxation of Nonconvex Problems 186

4.6 The Optimal Value Function 191

4.7 The Augmented Lagrangian 196


Chapter 5. Unconstrained Optimization of Differentiable Functions 211

5.1 Introduction to Iterative Algorithms 211

5.2 Line Search 213

5.3 The Method of Steepest Descent 218

5.4 Newton's Method 233

5.5 The Conjugate Gradient Method 240

5.6 Quasi-Newton Methods 257

5.7 Trust Region Methods 266

5.8 Nongradient Methods 275

Chapter 6. Constrained Optimization of Differentiable Functions 286

6.1 Feasible Point Methods 286

6.2 Penalty Methods 297

6.3 The Basic Dual Method 308

6.4 The Augmented Lagrangian Method 311

6.5 Newton's Method 324

6.6 Barrier Methods 331

Chapter 7. Nondifferentiable Optimization 343

7.1 The Subgradient Method 343

7.2 The Cutting Plane Method 357

7.3 The Proximal Point Method 366

7.4 The Bundle Method 372

7.5 The Trust Region Method 384

7.6 Constrained Problems 389

7.7 Composite Optimization 397

7.8 Nonconvex Constraints 406

Appendix A. Stability of Set-Constrained Systems 411

A.1 Linear-Conic Systems 411

A.2 Set-Constrained Linear Systems 415

A.3 Set-Constrained Nonlinear Systems 418

Further Reading 427

Bibliography 431

Index 445

Customer Reviews

Most Helpful Customer Reviews

See All Customer Reviews

Nonlinear Optimization 5 out of 5 based on 0 ratings. 1 reviews.
Guest More than 1 year ago
This outstanding book fills the need for a recent introductory graduate textbook in nonlinear convex optimization. The book is divided into 2 parts: Part I deals with theory while Part II deals with algorithms for nonlinear convex optimization. Topics covered in Part I include basic convex analysis, optimality conditions, and Lagrangian duality. There are a number of interesting examples distributed throughout the discussions in Part I - some of these examples include recent concepts like semidefinite programming. The author also highlights the importance of DIFFERENTIABILITY in convex optimization - in fact he devotes separate sections for the optimality conditions of smooth convex and nonsmooth convex problems. Part II discusses algorithms for smooth unconstrained and constrained optimization and finally subgradient, bundle, and trust region schemes for nondifferentiable optimization. The discussion on algorithms for nondifferentiable optimization is new and an important ingredient in this book - for more details one can refer to the 2 volume set by Hiriart-Urruty and Lemarechal. However, there is no discussion on INTERIOR POINT METHODS and this is the only notable omission in the book. For more on interior point methods in nonlinear optimization, one can refer to the recent book by Nocedal and Wright. Personally, I enjoyed this book immensely, and I look forward to using it in a graduate course on nonlinear optimization.