Missing Data in Research on Youth and Family Programs

Jaime Ballard, Adeya N Richmond, Suzanne van den Hoogenhof, Lynne Borden, Daniel Francis Perkins

Research output: Contribution to journalArticlepeer-review

Abstract

Background: Multilevel data can be missing at the individual level or at a nested level, such as family, classroom, or program site. Increased knowledge of higher-level missing data is necessary to develop evaluation design and statistical methods to address it. Methods: Participants included 9,514 individuals participating in 47 youth and family programs nationwide who completed multiple self-report measures before and after program participation. Data were marked as missing or not missing at the item, scale, and wave levels for both individuals and program sites. Results: Site-level missing data represented a substantial portion of missing data, ranging from 0–46% of missing data at pre-test and 35–71% of missing data at post-test. Youth were the most likely to be missing data, although site-level data did not differ by the age of participants served. In this dataset youth had the most surveys to complete, so their missing data could be due to survey fatigue. Conclusions: Much of the missing data for individuals can be explained by the site not administering those questions or scales. These results suggest a need for statistical methods that account for site-level missing data, and for research design methods to reduce the prevalence of site-level missing data or reduce its impact. Researchers can generate buy-in with sites during the community collaboration stage, assessing problematic items for revision or removal and need for ongoing site support, particularly at post-test. We recommend that researchers conducting multilevel data report the amount and mechanism of missing data at each level.

Original languageEnglish (US)
JournalPsychological reports
DOIs
StateAccepted/In press - 2021

Bibliographical note

Funding Information:
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The authors gratefully acknowledge funding provided by the United States Department of Agriculture’s National Institute of Food and Agriculture (USDA-NIFA) through a cooperative agreement with the University of Minnesota and Pennsylvania State University under Grant 2018–41520-28908.

Publisher Copyright:
© The Author(s) 2021.

Keywords

  • Applications of statistical technique
  • correct use of statistical techniques
  • missing data
  • psychometrics
  • service provision

PubMed: MeSH publication types

  • Journal Article

Fingerprint

Dive into the research topics of 'Missing Data in Research on Youth and Family Programs'. Together they form a unique fingerprint.

Cite this