TY - JOUR
T1 - Replicating an established open skills curriculum
T2 - Are the same results obtained in a different setting?
AU - Brunsvold, Melissa E
AU - Schmitz, Constance C
N1 - Publisher Copyright:
© 2014 Association of Program Directors in Surgery.
PY - 2014/11/1
Y1 - 2014/11/1
N2 - Introduction The aim of this study was to ascertain whether the University of Texas, Southwestern (UTSW) open skills curriculum (Goova et al.13) could be successfully implemented in the University of Minnesota (UMN) multisite training program.Methods Postgraduate year-1 residents (n = 22) were enrolled in the curriculum, which included orientation, access to video instruction, 3 months of independent practice using portable kits and practice logbooks, presurveys and postsurveys, and pretesting and posttesting. Evaluation was based on UTSW proficiency measures (time, errors, and total proficiency score). Descriptive statistics, paired sample t tests, analysis of variance, and bivariate correlations were calculated.Results were compared with Goova.Results Startup costs at UMN were $9804 vs $776 at UTSW. Our curriculum required 51 direct faculty hours vs 376 at UTSW. UMN trainees' skills improved significantly (mean score = 973 [standard deviation = 267] at baseline vs 1325 [standard deviation = 215] at posttest), but they achieved proficiency in only 38.6% of tasks at posttest, compared with 88.7% by UTSW trainees. Best predictors of UMN posttest proficiency score were (1) categorical vs preliminary resident status (p < 0.001), (2) pretest proficiency score (r = 0.510, p = 0.008), and (3) self-assessed baseline proficiency (r = 0.415, p = 0.027). Participation in skills laboratories during clerkship or fourth year medical school, estimated number of cases (surgeon or first assistant), and number of practice repetitions recorded in booklets were not predictive of the posttest score.Conclusions The UTSW open skills curriculum is feasible and effective in a new setting. Differences from UTSW-published success rates may be related to their superior onsite monitoring of practice and a policy requiring residents to achieve proficiency for each task before posttesting.
AB - Introduction The aim of this study was to ascertain whether the University of Texas, Southwestern (UTSW) open skills curriculum (Goova et al.13) could be successfully implemented in the University of Minnesota (UMN) multisite training program.Methods Postgraduate year-1 residents (n = 22) were enrolled in the curriculum, which included orientation, access to video instruction, 3 months of independent practice using portable kits and practice logbooks, presurveys and postsurveys, and pretesting and posttesting. Evaluation was based on UTSW proficiency measures (time, errors, and total proficiency score). Descriptive statistics, paired sample t tests, analysis of variance, and bivariate correlations were calculated.Results were compared with Goova.Results Startup costs at UMN were $9804 vs $776 at UTSW. Our curriculum required 51 direct faculty hours vs 376 at UTSW. UMN trainees' skills improved significantly (mean score = 973 [standard deviation = 267] at baseline vs 1325 [standard deviation = 215] at posttest), but they achieved proficiency in only 38.6% of tasks at posttest, compared with 88.7% by UTSW trainees. Best predictors of UMN posttest proficiency score were (1) categorical vs preliminary resident status (p < 0.001), (2) pretest proficiency score (r = 0.510, p = 0.008), and (3) self-assessed baseline proficiency (r = 0.415, p = 0.027). Participation in skills laboratories during clerkship or fourth year medical school, estimated number of cases (surgeon or first assistant), and number of practice repetitions recorded in booklets were not predictive of the posttest score.Conclusions The UTSW open skills curriculum is feasible and effective in a new setting. Differences from UTSW-published success rates may be related to their superior onsite monitoring of practice and a policy requiring residents to achieve proficiency for each task before posttesting.
KW - assessment
KW - curriculum
KW - education
KW - residents
KW - surgery
KW - technical skills
UR - http://www.scopus.com/inward/record.url?scp=84919961110&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84919961110&partnerID=8YFLogxK
U2 - 10.1016/j.jsurg.2014.08.001
DO - 10.1016/j.jsurg.2014.08.001
M3 - Article
C2 - 25245520
AN - SCOPUS:84919961110
SN - 1931-7204
VL - 71
SP - e97-e103
JO - Journal of surgical education
JF - Journal of surgical education
IS - 6
ER -