TY - JOUR
T1 - Criterion-Related Validity
T2 - Assessing the Value of Subscores
AU - Davison, Mark L.
AU - Davenport, Ernest C.
AU - Chang, Yu Feng
AU - Vue, Kory
AU - Su, Shiyang
N1 - Publisher Copyright:
© 2015 by the National Council on Measurement in Education.
PY - 2015/9/1
Y1 - 2015/9/1
N2 - Criterion-related profile analysis (CPA) can be used to assess whether subscores of a test or test battery account for more criterion variance than does a single total score. Application of CPA to subscore evaluation is described, compared to alternative procedures, and illustrated using SAT data. Considerations other than validity and reliability are discussed, including broad societal goals (e.g., affirmative action), fairness, and ties in expected criterion predictions. In simulation data, CPA results were sensitive to subscore correlations, sample size, and the proportion of criterion-related variance accounted for by the subscores. CPA can be a useful component in a thorough subscore evaluation encompassing subscore reliability, validity, distinctiveness, fairness, and broader societal goals.
AB - Criterion-related profile analysis (CPA) can be used to assess whether subscores of a test or test battery account for more criterion variance than does a single total score. Application of CPA to subscore evaluation is described, compared to alternative procedures, and illustrated using SAT data. Considerations other than validity and reliability are discussed, including broad societal goals (e.g., affirmative action), fairness, and ties in expected criterion predictions. In simulation data, CPA results were sensitive to subscore correlations, sample size, and the proportion of criterion-related variance accounted for by the subscores. CPA can be a useful component in a thorough subscore evaluation encompassing subscore reliability, validity, distinctiveness, fairness, and broader societal goals.
UR - http://www.scopus.com/inward/record.url?scp=84940838639&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84940838639&partnerID=8YFLogxK
U2 - 10.1111/jedm.12081
DO - 10.1111/jedm.12081
M3 - Article
AN - SCOPUS:84940838639
SN - 0022-0655
VL - 52
SP - 263
EP - 279
JO - Journal of Educational Measurement
JF - Journal of Educational Measurement
IS - 3
ER -
