Development and initial validation of a project-based rubric to assess the systems-based practice competency of residents in the clinical chemistry rotation of a pathology residency

Carolyn R. Vitek, Jane C. Dale, Henry A. Homburger, Sandra C. Bryant, Amy K. Saenger, Brad S. Karon

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

Context.-Systems-based practice (SBP) is 1 of 6 core competencies required in all resident training programs accredited by the Accreditation Council for Graduate Medical Education. Reliable methods of assessing resident competency in SBP have not been described in the medical literature. Objective.-To develop and validate an analytic grading rubric to assess pathology residents' analyses of SBP problems in clinical chemistry. Design.-Residents were assigned an SBP project based upon unmet clinical needs in the clinical chemistry laboratories. Using an iterative method, we created an analytic grading rubric based on critical thinking principles. Four faculty raters used the SBP project evaluation rubric to independently grade 11 residents' projects during their clinical chemistry rotations. Interrater reliability and Cronbach a were calculated to determine the reliability and validity of the rubric. Project mean scores and range were also assessed to determine whether the rubric differentiated resident critical thinking skills related to the SBP projects. Results.-Overall project scores ranged from 6.56 to 16.50 out of a possible 20 points. Cronbach a ranged from 0.91 to 0.96, indicating that the 4 rubric categories were internally consistent without significant overlap. Intraclass correlation coefficients ranged from 0.63 to 0.81, indicating moderate to strong interrater reliability. Conclusions.-We report development and statistical analysis of a novel SBP project evaluation rubric. The results indicate the rubric can be used to reliably assess pathology residents' critical thinking skills in SBP.

Original languageEnglish (US)
Pages (from-to)809-813
Number of pages5
JournalArchives of Pathology and Laboratory Medicine
Volume138
Issue number6
DOIs
StatePublished - Jun 2014

Fingerprint

Dive into the research topics of 'Development and initial validation of a project-based rubric to assess the systems-based practice competency of residents in the clinical chemistry rotation of a pathology residency'. Together they form a unique fingerprint.

Cite this