Only Incumbent Raters in O*NET? Oh Yes! Oh No!

Philip T. Walmsley; Michael W. Natali; John P. Campbell

doi:10.1111/j.1468-2389.2012.00600.x

Only Incumbent Raters in O*NET? Oh Yes! Oh No!

Philip T. Walmsley, Michael W. Natali, John P. Campbell

Psychology (Twin Cities)

Research output: Contribution to journal › Article › peer-review

Abstract

Recent evaluation of the US Department of Labor's Occupational Information Network (O*NET) suggested that ratings from occupational analysts could be replaced by data imputed from incumbents' ratings. This study evaluates the viability of imputing job descriptor data, usually provided by analysts (ability ratings), using regression-weighted incumbent task ratings. This study also uses (O*NET) databases to compare a series of possible strategies for imputing task, ability, and skill data on the basis of either incumbent or analyst ratings. Findings do not provide clear support for the superiority of using one data source over another when imputing ratings. Imputed and existing ratings are shown not to be equivalent based on variance explained statistics and comparisons of factor structures, indicating that both sources provide unique information.

Original language	English (US)
Pages (from-to)	283-296
Number of pages	14
Journal	International Journal of Selection and Assessment
Volume	20
Issue number	3
DOIs	https://doi.org/10.1111/j.1468-2389.2012.00600.x
State	Published - Sep 2012

Access

10.1111/j.1468-2389.2012.00600.x

OpenUrl availability

Full text

Cite this

@article{9deb8475ea274213a5e2f1cdd2399bdb,

title = "Only Incumbent Raters in O*NET? Oh Yes! Oh No!",

abstract = "Recent evaluation of the US Department of Labor's Occupational Information Network (O*NET) suggested that ratings from occupational analysts could be replaced by data imputed from incumbents' ratings. This study evaluates the viability of imputing job descriptor data, usually provided by analysts (ability ratings), using regression-weighted incumbent task ratings. This study also uses (O*NET) databases to compare a series of possible strategies for imputing task, ability, and skill data on the basis of either incumbent or analyst ratings. Findings do not provide clear support for the superiority of using one data source over another when imputing ratings. Imputed and existing ratings are shown not to be equivalent based on variance explained statistics and comparisons of factor structures, indicating that both sources provide unique information.",

author = "Walmsley, {Philip T.} and Natali, {Michael W.} and Campbell, {John P.}",

year = "2012",

month = sep,

doi = "10.1111/j.1468-2389.2012.00600.x",

language = "English (US)",

volume = "20",

pages = "283--296",

journal = "International Journal of Selection and Assessment",

issn = "0965-075X",

publisher = "Wiley-Blackwell",

number = "3",

}

TY - JOUR

T1 - Only Incumbent Raters in O*NET? Oh Yes! Oh No!

AU - Walmsley, Philip T.

AU - Natali, Michael W.

AU - Campbell, John P.

PY - 2012/9

Y1 - 2012/9

N2 - Recent evaluation of the US Department of Labor's Occupational Information Network (O*NET) suggested that ratings from occupational analysts could be replaced by data imputed from incumbents' ratings. This study evaluates the viability of imputing job descriptor data, usually provided by analysts (ability ratings), using regression-weighted incumbent task ratings. This study also uses (O*NET) databases to compare a series of possible strategies for imputing task, ability, and skill data on the basis of either incumbent or analyst ratings. Findings do not provide clear support for the superiority of using one data source over another when imputing ratings. Imputed and existing ratings are shown not to be equivalent based on variance explained statistics and comparisons of factor structures, indicating that both sources provide unique information.

AB - Recent evaluation of the US Department of Labor's Occupational Information Network (O*NET) suggested that ratings from occupational analysts could be replaced by data imputed from incumbents' ratings. This study evaluates the viability of imputing job descriptor data, usually provided by analysts (ability ratings), using regression-weighted incumbent task ratings. This study also uses (O*NET) databases to compare a series of possible strategies for imputing task, ability, and skill data on the basis of either incumbent or analyst ratings. Findings do not provide clear support for the superiority of using one data source over another when imputing ratings. Imputed and existing ratings are shown not to be equivalent based on variance explained statistics and comparisons of factor structures, indicating that both sources provide unique information.

UR - http://www.scopus.com/inward/record.url?scp=84864860905&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84864860905&partnerID=8YFLogxK

U2 - 10.1111/j.1468-2389.2012.00600.x

DO - 10.1111/j.1468-2389.2012.00600.x

M3 - Article

AN - SCOPUS:84864860905

SN - 0965-075X

VL - 20

SP - 283

EP - 296

JO - International Journal of Selection and Assessment

JF - International Journal of Selection and Assessment

IS - 3

ER -

Only Incumbent Raters in O*NET? Oh Yes! Oh No!

Abstract

Access

OpenUrl availability

Other files and links

Fingerprint

Cite this