Commentary on “Validation Methods for Aggregate-Level Test Scale Linking: A Case Study Mapping School District Test Score Distributions to a Common Scale”

Research output: Contribution to journalComment/debatepeer-review

Abstract

This paper begins by setting the linking methods of Reardon, Kalogrides, and Ho in the broader literature on linking. Trends in the validity data suggest that there may be a conditional bias in the estimates of district means, but the data in the article are not conclusive on this point. Further, the data used in their case study might support the validity of the methods only over a limited range of the ability continuum. Applications of the method are then discussed. Contrary to the title, the application of the linking results is not limited to aggregate-level data. Because the potential application is so broad, further research is needed on issues such as the possibility of conditional bias and the validity of estimates over the full range of possible values. Validity is not a dichotomous concept where validity exists or it does not. The evidence reported by Reardon et al. provides substantial, but incomplete, support for the validity of the linked measures in this case study.

Original languageEnglish (US)
Pages (from-to)173-186
Number of pages14
JournalJournal of Educational and Behavioral Statistics
Volume46
Issue number2
DOIs
StatePublished - Apr 2021

Bibliographical note

Publisher Copyright:
© 2020 AERA.

Keywords

  • NAEP
  • achievement
  • assessment
  • case studies
  • equating
  • measurements
  • psychometrics
  • testing
  • validity/reliability

Fingerprint

Dive into the research topics of 'Commentary on “Validation Methods for Aggregate-Level Test Scale Linking: A Case Study Mapping School District Test Score Distributions to a Common Scale”'. Together they form a unique fingerprint.

Cite this