An augmented Lagrangian method for non-Lipschitz nonconvex programming

Xiaojun Chen, Lei Guo, Zhaosong Lu, Jane J. Ye

Research output: Contribution to journalArticlepeer-review

13 Scopus citations

Abstract

We consider a class of constrained optimization problems where the objective function is a sum of a smooth function and a nonconvex non-Lipschitz function. Many problems in sparse portfolio selection, edge preserving image restoration, and signal processing can be modelled in this form. First, we propose the concept of the Karush-Kuhn-Tucker (KKT) stationary condition for the non-Lipschitz problem and show that it is necessary for optimality under a constraint qualification called the relaxed constant positive linear dependence (RCPLD) condition, which is weaker than the Mangasarian-Fromovitz constraint qualification and holds automatically if all the constraint functions are affine. Then we propose an augmented Lagrangian (AL) method in which the augmented Lagrangian subproblems are solved by a nonmonotone proximal gradient method. Under the assumption that a feasible point is known, we show that any accumulation point of the sequence generated by our method must be a feasible point. Moreover, if RCPLD holds at such an accumulation point, then it is a KKT point of the original problem. Finally, we conduct numerical experiments to compare the performance of our AL method and the interior point (IP) method for solving two sparse portfolio selection models. The numerical results demonstrate that our method is not only comparable to the IP method in terms of solution quality, but also substantially faster than the IP method.

Original languageEnglish (US)
Pages (from-to)168-193
Number of pages26
JournalSIAM Journal on Numerical Analysis
Volume55
Issue number1
DOIs
StatePublished - 2017
Externally publishedYes

Bibliographical note

Funding Information:
The work of the first author was supported in part by Hong Kong Research Grants Council PolyU5002/13p. The work of the second author was supported by NSFC grant (11401379) and the China Postdoctoral Science Foundation (2015T80428). The work of the third and fourth authors was supported in part by NSERC.

Publisher Copyright:
© 2017 Society for Industrial and Applied Mathematics.

Copyright:
Copyright 2017 Elsevier B.V., All rights reserved.

Keywords

  • Augmented Lagrangian method
  • Non-Lipschitz programming
  • Sparse optimization

Fingerprint Dive into the research topics of 'An augmented Lagrangian method for non-Lipschitz nonconvex programming'. Together they form a unique fingerprint.

Cite this