skip to main content
Department of Computer Science University of Colorado Boulder
cu: home | engineering | mycuinfo | about | cu a-z | search cu | contact cu cs: about | calendar | directory | catalog | schedules | mobile | contact cs
home · events · thesis defenses · 2006-2007 · 

Thesis Defense - Jiang

ECOT 831

Preconditioning the Limited-Memory BFGS Algorithm
Computer Science PhD Candidate

For large scale unconstrained optimization, truncated Newton methods and limited memory quasi-Newton methods are most effective choices. Often, the truncated Newton method adopts a preconditioner to speed up the convergence. However, very little previous study has explored the possibility of using a preconditioner in the limited memory quasi-Newton method. In this thesis, we focus on the LBFGS method, which belongs to the limited memory quasi-Newton methods, and we implement and study this preconditioned LBFGS algorithm (PLBFGS).

We did experiments on protein structure prediction problems with three kinds of preconditioners constructed from the protein potential energy function. We also did experiments on a set of general test problems using a general preconditioner, the incomplete Cholesky factorization preconditioner. The results show that PLBFGS method has significant performance improvement over LBFGS algorithm by using the preconditioners, and performs competitively with the preconditioned truncated Newton method.

Committee: Richard Byrd, Professor (Chair)
Robert (Bobby) Schnabel, Professor
Xiao-Chuan Cai, Professor
Elizabeth Jessup, Professor
Thomas Manteuffel, Department of Applied Mathematics

See also:
Department of Computer Science
College of Engineering and Applied Science
University of Colorado Boulder
Boulder, CO 80309-0430 USA
Send email to

Engineering Center Office Tower
ECOT 717
FAX +1-303-492-2844
XHTML 1.0/CSS2 ©2012 Regents of the University of Colorado
Privacy · Legal · Trademarks
May 5, 2012 (13:40)