Individually randomized group treatment trials: A critical appraisal of frequently used design and analytic approaches

Sherri L. Pals, David M. Murray, Catherine M. Alfano, William R. Shadish, Peter J. Hannan, William L. Baker

Research output: Contribution to journalReview articlepeer-review

46 Scopus citations

Abstract

Objectives. We reviewed published individually randomized group treatment (IRGT) trials to assess researchers' awareness of within-group correlation and determine whether appropriate design and analytic methods were used to test for treatment effectiveness. Methods. We assessed sample size and analytic methods in IRGT trials published in 6 public health and behavioral health journals between 2002 and 2006. Results. Our review included 34 articles; in 32 (94.1%) of these articles, inappropriate analytic methods were used. In only 1 article did the researchers claim that expected intraclass correlations (ICCs) were taken into account in sample size estimation; in most articles, sample size was not mentioned or ICCs were ignored in the reported calculations. Conclusions. Trials in which individuals are randomly assigned to study conditions and treatments administered in groups may induce within-group correlation, violating the assumption of independence underlying commonly used statistical methods. Methods that take expected ICCs into account should be used in reexamining past studies and planning future studies to ensure that interventions are not judged effective solely on the basis of statistical artifacts. We strongly encourage investigators to report ICCs from IRGT trials and describe study characteristics clearly to aid these efforts.

Original languageEnglish (US)
Pages (from-to)1418-1424
Number of pages7
JournalAmerican journal of public health
Volume98
Issue number8
DOIs
StatePublished - Aug 1 2008

Fingerprint Dive into the research topics of 'Individually randomized group treatment trials: A critical appraisal of frequently used design and analytic approaches'. Together they form a unique fingerprint.

Cite this