Bayesian variance estimation for meta-analysis: Quantifying our uncertainty

Piers D.G. Steel, John Kammeyer-Mueller

Research output: Contribution to journalArticlepeer-review

22 Scopus citations

Abstract

A primary goal in meta-analysis is determining the variance across a set of correlations after taking into account statistical and psychometric artifacts. If the residual variance is large, substantive moderators of the relationship likely exist; if there is little residual variance, the meta-analytic estimate of the effect size is expected to generalize across multiple settings. Surprisingly little attention has been directed toward some critical shortcomings of traditional methods for estimating residual variance. In this article, the authors argue that residual variance estimates are often based on an unrealistic model of the sampling distribution of residual variance. The authors review alternative Bayesian techniques for estimation that avoid these problems and provide simulation results demonstrating the superiority of the Bayesian approach.

Original languageEnglish (US)
Pages (from-to)54-78
Number of pages25
JournalOrganizational Research Methods
Volume11
Issue number1
DOIs
StatePublished - Jan 1 2008
Externally publishedYes

Keywords

  • Bayesian analysis
  • Bootstrapping
  • Computer simulation techniques
  • Generalizability theory
  • Meta-analysis
  • Monte Carlo

Fingerprint Dive into the research topics of 'Bayesian variance estimation for meta-analysis: Quantifying our uncertainty'. Together they form a unique fingerprint.

Cite this