Efficient global approximation of generalized nonlinear ℓ1 -Regularized solution paths and its applications

Ming Yuan, Hui Zou

Research output: Contribution to journalArticlepeer-review

7 Scopus citations

Abstract

We consider efficient construction of nonlinear solution paths for general ℓ1-regularization. Unlike the existing methods that incrementally build the solution path through a combination of local linear approximation and recalibration, we propose an efficient global approximation to the whole solution path. With the loss function approximated by a quadratic spline, we show that the solution path can be computed using a generalized Lars algorithm. The proposed methodology avoids high-dimensional numerical optimization and thus provides faster and more stable computation. The methodology also can be easily extended to more general regularization framework. We illustrate such flexibility with several examples, including a generalization of the elastic net and a new method that effectively exploits the so-called "support vectors" in kernel logistic regression.

Original languageEnglish (US)
Pages (from-to)1562-1574
Number of pages13
JournalJournal of the American Statistical Association
Volume104
Issue number488
DOIs
StatePublished - Dec 2009

Bibliographical note

Funding Information:
Ming Yuan is Associate Professor, School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, GA 30332-0205 (E-mail: myuan@isye.gatech.edu). Hui Zou is Associate Professor, School of Statistics, University of Minnesota, Minneapolis, MN 55455 (E-mail: hzou@stat.umn. edu). Yuan’s research was supported in part by National Science Foundation (NSF) grant DMS-0706724. Zou’s research was supported in part by NSF grant DMS-0706733.

Keywords

  • LARS
  • LASSO
  • Solution path
  • Support vector pursuit
  • ℓ-regularization

Fingerprint Dive into the research topics of 'Efficient global approximation of generalized nonlinear ℓ<sub>1</sub> -Regularized solution paths and its applications'. Together they form a unique fingerprint.

Cite this