Abstract
We study the asymptotic behavior of predictions from partial least squares (PLS) regression as the sample size and number of predictors diverge in various alignments. We show that there is a range of regression scenarios where PLS predictions have the usual root-n convergence rate, even when the sample size is substantially smaller than the number of predictors, and an even wider range where the rate is slower but may still produce practically useful results. We show also that PLS predictions achieve their best asymptotic behavior in abundant regressions where many predictors contribute information about the response. Their asymptotic behavior tends to be undesirable in sparse regressions where few predictors contribute information about the response.
Original language | English (US) |
---|---|
Pages (from-to) | 884-908 |
Number of pages | 25 |
Journal | Annals of Statistics |
Volume | 47 |
Issue number | 2 |
DOIs | |
State | Published - Apr 2019 |
Bibliographical note
Publisher Copyright:© Institute of Mathematical Statistics, 2019
Keywords
- Abundant regressions
- Dimension reduction
- Sparse regressions