TY - JOUR
T1 - Bayesian variance estimation for meta-analysis
T2 - Quantifying our uncertainty
AU - Steel, Piers D.G.
AU - Kammeyer-Mueller, John
PY - 2008/1
Y1 - 2008/1
N2 - A primary goal in meta-analysis is determining the variance across a set of correlations after taking into account statistical and psychometric artifacts. If the residual variance is large, substantive moderators of the relationship likely exist; if there is little residual variance, the meta-analytic estimate of the effect size is expected to generalize across multiple settings. Surprisingly little attention has been directed toward some critical shortcomings of traditional methods for estimating residual variance. In this article, the authors argue that residual variance estimates are often based on an unrealistic model of the sampling distribution of residual variance. The authors review alternative Bayesian techniques for estimation that avoid these problems and provide simulation results demonstrating the superiority of the Bayesian approach.
AB - A primary goal in meta-analysis is determining the variance across a set of correlations after taking into account statistical and psychometric artifacts. If the residual variance is large, substantive moderators of the relationship likely exist; if there is little residual variance, the meta-analytic estimate of the effect size is expected to generalize across multiple settings. Surprisingly little attention has been directed toward some critical shortcomings of traditional methods for estimating residual variance. In this article, the authors argue that residual variance estimates are often based on an unrealistic model of the sampling distribution of residual variance. The authors review alternative Bayesian techniques for estimation that avoid these problems and provide simulation results demonstrating the superiority of the Bayesian approach.
KW - Bayesian analysis
KW - Bootstrapping
KW - Computer simulation techniques
KW - Generalizability theory
KW - Meta-analysis
KW - Monte Carlo
UR - http://www.scopus.com/inward/record.url?scp=37149021788&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=37149021788&partnerID=8YFLogxK
U2 - 10.1177/1094428107300339
DO - 10.1177/1094428107300339
M3 - Article
AN - SCOPUS:37149021788
SN - 1094-4281
VL - 11
SP - 54
EP - 78
JO - Organizational Research Methods
JF - Organizational Research Methods
IS - 1
ER -