ICCOPT 2013 Talk, Room 1.3, Wednesday, July 31, 11:30-13:00

 Speaker: Tove Odland, Optimization and Systems Theory, Department of Mathematics, KTH Royal Institute of Technology, Stockholm, Sweden
 Title: On the connection between the conjugate gradient method and quasi-Newton methods on quadratic problems
 Co-authors: Anders Forsgren

 Abstract:
Scientific Program

It is well known that the conjugate gradient method and a quasi-Newton method, using any well-defined update matrix from the one-parameter Broyden family of updates, produce the same iterates on a quadratic problem with positive-definite Hessian. This equivalence does not hold for any quasi-Newton method. We discuss more precisely the conditions on the update matrix that give rise to this behavior, and show that the crucial fact is that the components of each update matrix are chosen in the last two dimensions of the Krylov subspaces defined by the conjugate gradient method. In the framework based on a sufficient condition to obtain mutually conjugate search directions, we show that the one-parameter Broyden family is complete. We also show that the update matrices from the one-parameter Broyden family is almost always well-defined on a quadratic problem with positive-definite Hessian. The only exception is when the symmetric rank-one update is used and the unit steplength is taken in the same iteration, in this case it is the Broyden parameter that becomes undefined.


 Talk in: Session Wed.A.13 Nonlinear optimization and linear algebra
 Cluster: Nonlinear optimization


 Go to: Wed.A
 Go to: unframed Scientific Program

 Go to: ICCOPT 2013 Main Webpage