Bayesian high-dimensional regression for change point analysis

Abhirup Datta, Hui Zou, Sudipto Banerjee

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

In many econometrics applications, the dataset under investigation spans heterogeneous regimes that are more appropriately modeled using piece-wise components for each of the data segments separated by change-points. We consider using Bayesian high-dimensional shrinkage priors in a change point setting to understand segment-specific relationship between the response and the covariates. Covariate selection before and after each change point can identify possibly different sets of relevant covariates, while the fully Bayesian approach ensures posterior inference for the change points is also available. We demonstrate the flexibility of the approach for imposing different variable selection constraints like grouping or partial selection and discuss strategies to detect an unknown number of change points. Simulation experiments reveal that this simple approach delivers accurate variable selection, and inference on location of the change points, and substantially outperforms a frequentist lasso-based approach, uniformly across a wide range of scenarios. Application of our model to Minnesota house price dataset reveals change in the relationship between house and stock prices around the sub-prime mortgage crisis.

Original languageEnglish (US)
Pages (from-to)253-264
Number of pages12
JournalStatistics and its Interface
Volume12
Issue number2
DOIs
StatePublished - 2019

Bibliographical note

Funding Information:
∗We thank the Editors, the Associate Editor and Referees for their suggestions that improved the article considerably. Sudipto Banerjee’s work was supported, in part, by grants NIH/NIEHS 1R01ES027027-01, NSF IIS-1562303 and NSF DMS-1513654. †Corresponding author.

Funding Information:
Sudipto Banerjee's work was supported, in part, by grants NIH/NIEHS 1R01ES027027-01, NSF IIS-1562303 and NSF DMS-1513654.

Publisher Copyright:
© 2019, International Press of Boston, Inc.

Keywords

  • Bayesian inference
  • Change point detection
  • High-dimensional regression
  • Markov Chain Monte Carlo
  • Minnesota House Price Data
  • Variable selection

Fingerprint

Dive into the research topics of 'Bayesian high-dimensional regression for change point analysis'. Together they form a unique fingerprint.

Cite this