Predictor content matters for knowledge testing: Evidence supporting content validation

Paul R. Sackett, Philip T. Walmsley, Amanda J. Koch, Adam S. Beatty, Nathan R. Kuncel

Research output: Contribution to journalArticlepeer-review

6 Scopus citations

Abstract

Organizations often rely on the match between job requirements and test content to justify test use. This practice has been questioned on the grounds that content validation has little relevance to criterion-related validation due to positive manifold among predictors. We analyze two large databases to assess the implications of test content for (a) test interchangeability and (b) criterion-related validity. Analyses of 15 knowledge tests administered (N = 80,394) as part of Project Talent demonstrate that test content is related to predictor interchangeability. Analyses of SAT and Advanced Placement test data compare correlations among predictors and criteria drawn from matched and unmatched content domains. We conclude that test-criterion content match is likely to result in stronger criterion-related validity.

Original languageEnglish (US)
Pages (from-to)54-71
Number of pages18
JournalHuman Performance
Volume29
Issue number1
DOIs
StatePublished - Jan 1 2016

Fingerprint Dive into the research topics of 'Predictor content matters for knowledge testing: Evidence supporting content validation'. Together they form a unique fingerprint.

Cite this