TY - JOUR
T1 - Policy considerations based on a cost analysis of alternative test formats in large scale science assessments
AU - Lawrenz, Frances
AU - Huffman, Douglas
AU - Welch, Wayne
PY - 2000/8
Y1 - 2000/8
N2 - This article compares the costs of four assessment formats: multiple choice, open ended, laboratory station, and full investigation. The amount of time spent preparing the devices, developing scoring consistency for the devices, and scoring the devices was tracked as the devices were developed. These times are presented by individual item and by complete device. Times are also compared as if 1,000 students completed each assessment. Finally, the times are converted into cost estimates by assuming a potential hourly wage. The data show that a multiple choice item costs the least, and that it is approximately 80 times as much for an open ended item, 300 times as much for a content station, and 500 times as much for a full investigation item. The very large discrepancies in costs are used as a basis to raise several policy issues related to the inclusion of alternative assessment formats in large scale science achievement testing.
AB - This article compares the costs of four assessment formats: multiple choice, open ended, laboratory station, and full investigation. The amount of time spent preparing the devices, developing scoring consistency for the devices, and scoring the devices was tracked as the devices were developed. These times are presented by individual item and by complete device. Times are also compared as if 1,000 students completed each assessment. Finally, the times are converted into cost estimates by assuming a potential hourly wage. The data show that a multiple choice item costs the least, and that it is approximately 80 times as much for an open ended item, 300 times as much for a content station, and 500 times as much for a full investigation item. The very large discrepancies in costs are used as a basis to raise several policy issues related to the inclusion of alternative assessment formats in large scale science achievement testing.
UR - http://www.scopus.com/inward/record.url?scp=0041723533&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=0041723533&partnerID=8YFLogxK
U2 - 10.1002/1098-2736(200008)37:6<615::AID-TEA7>3.0.CO;2-A
DO - 10.1002/1098-2736(200008)37:6<615::AID-TEA7>3.0.CO;2-A
M3 - Article
AN - SCOPUS:0041723533
SN - 0022-4308
VL - 37
SP - 615
EP - 626
JO - Journal of Research in Science Teaching
JF - Journal of Research in Science Teaching
IS - 6
ER -