The impact of target, wording, and duration on rating accuracy for direct behavior rating

Sandra M. Chafouleas, Rose Jaffery, T. Chris Riley-Tillman, Theodore J. Christ, Rohini Sen

Research output: Contribution to journalArticlepeer-review

7 Scopus citations

Abstract

The purpose of this study was to extend evaluation of rater accuracy using Direct Behavior Rating-Single-Item Scales (DBRSIS). Extension of prior research was accomplished through use of criterion ratings derived from both systematic direct observation and expert DBR-SIS scores, and also through control of the durations over which the target behavior was displayed in each clip. Rating targets included academically engaged, disruptive, and respectful behavior. Undergraduate participants (n = 113) viewed video clips of classroom instruction and subsequently rated target students' behavior using DBR-SIS. Results indicated that both rater bias and rater error were present to some degree based on the behavior target, wording, and duration displayed, with greater bias found for the target involving respectful behavior. In addition, positive wording for academically engaged behavior resulted in improved accuracy, yet negative wording resulted in improved accuracy for disruptive and possibly respectful behavior. Implications for research and practice are discussed.

Original languageEnglish (US)
Pages (from-to)39-53
Number of pages15
JournalAssessment for Effective Intervention
Volume39
Issue number1
DOIs
StatePublished - Dec 2013

Keywords

  • Behavior assessment
  • Direct behavior rating
  • Rating accuracy

Fingerprint

Dive into the research topics of 'The impact of target, wording, and duration on rating accuracy for direct behavior rating'. Together they form a unique fingerprint.

Cite this