Online Proctored Versus Unproctored Low-Stakes Internet Test Administration: Is There Differential Test-Taking Behavior and Performance?

Joseph A. Rios, Ou Lydia Liu

Research output: Contribution to journalArticlepeer-review

34 Scopus citations

Abstract

Online higher education institutions are presented with the concern of how to obtain valid results when administering student learning outcomes (SLO) assessments remotely. Traditionally, there has been a great reliance on unproctored Internet test administration (UIT) due to increased flexibility and reduced costs; however, a number of validity concerns have led some researchers to question its implementation and results. To mitigate the limitations of UIT, a relatively new approach, referred to as online proctoring, has been developed to mirror in-person proctoring remotely by capitalizing on technology to create verifiable and secure testing conditions. This study evaluated the comparability of online proctored and unproctored test administration in a low-stakes testing context on user-friendliness, examinee behavior, and mean scores. Results demonstrated improved user-friendliness (e.g., ease of logging in); however, no significant differences were observed in terms of keystroke information, rapid guessing, or aggregated scores between proctoring conditions. Overall, these results suggest that online institutions can implement UIT, which is a cost-effective approach to test administration, and obtain valid group-level inferences from SLO assessments.

Original languageEnglish (US)
Pages (from-to)226-241
Number of pages16
JournalAmerican Journal of Distance Education
Volume31
Issue number4
DOIs
StatePublished - Oct 2 2017
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2017 Educational Testing Service.

Fingerprint

Dive into the research topics of 'Online Proctored Versus Unproctored Low-Stakes Internet Test Administration: Is There Differential Test-Taking Behavior and Performance?'. Together they form a unique fingerprint.

Cite this