TY - JOUR
T1 - Assessing instrument handling and operative consequences simultaneously
T2 - A simple method for creating synced multicamera videos for endosurgical or microsurgical skills assessments
AU - Jabbour, Noel
AU - Sidman, James D
PY - 2011/10/1
Y1 - 2011/10/1
N2 - There has been an increasing interest in assessment of technical skills in most medical and surgical disciplines. Many of these assessments involve microscopy or endoscopy and are thus amenable to video recording for post hoc review. An ideal skills assessment video would provide the reviewer with a simultaneous view of the examinee's instrument handling and the operative field. Ideally, a reviewer should be blinded to the identity of the examinee and whether the assessment was performed as a pretest or posttest examination, when given in conjunction with an educational intervention. Methods: We describe a simple method for reliably creating deidentified, multicamera, time-synced videos, which may be used in technical skills assessments. We pilot tested this method in a pediatric airway endoscopy Objective Assessment of Technical Skills (OSATS). Total video length was compared with the OSATS administration time. Results: Thirty-nine OSATS were administered. There were no errors encountered in time-syncing the videos using this method. Mean duration of OSATS videos was 11 minutes and 20 seconds, which was significantly less than the time needed for an expert to be present at the administration of each 30-minute OSATS (P < 0.001). Conclusions: The described method for creating time-synced, multicamera skills assessment videos is reliable and may be used in endosurgical or microsurgical skills assessments. Compared with live review, post hoc video review using this method can save valuable expert reviewer time. Most importantly, this method allows a reviewer to simultaneously evaluate an examinee's instrument handling and the operative field while being blinded to the examinee's identity and timing of examination administration.
AB - There has been an increasing interest in assessment of technical skills in most medical and surgical disciplines. Many of these assessments involve microscopy or endoscopy and are thus amenable to video recording for post hoc review. An ideal skills assessment video would provide the reviewer with a simultaneous view of the examinee's instrument handling and the operative field. Ideally, a reviewer should be blinded to the identity of the examinee and whether the assessment was performed as a pretest or posttest examination, when given in conjunction with an educational intervention. Methods: We describe a simple method for reliably creating deidentified, multicamera, time-synced videos, which may be used in technical skills assessments. We pilot tested this method in a pediatric airway endoscopy Objective Assessment of Technical Skills (OSATS). Total video length was compared with the OSATS administration time. Results: Thirty-nine OSATS were administered. There were no errors encountered in time-syncing the videos using this method. Mean duration of OSATS videos was 11 minutes and 20 seconds, which was significantly less than the time needed for an expert to be present at the administration of each 30-minute OSATS (P < 0.001). Conclusions: The described method for creating time-synced, multicamera skills assessment videos is reliable and may be used in endosurgical or microsurgical skills assessments. Compared with live review, post hoc video review using this method can save valuable expert reviewer time. Most importantly, this method allows a reviewer to simultaneously evaluate an examinee's instrument handling and the operative field while being blinded to the examinee's identity and timing of examination administration.
KW - Endoscopy training
KW - Endosurgery training
KW - Microsurgery training
KW - Objective structured assessment of technical skills (OSATS)
KW - Split screen
KW - Surgical skills assessment
KW - Video review
UR - http://www.scopus.com/inward/record.url?scp=80053952181&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=80053952181&partnerID=8YFLogxK
U2 - 10.1097/SIH.0b013e318216fce4
DO - 10.1097/SIH.0b013e318216fce4
M3 - Review article
C2 - 21527869
AN - SCOPUS:80053952181
SN - 1559-2332
VL - 6
SP - 299
EP - 303
JO - Simulation in Healthcare
JF - Simulation in Healthcare
IS - 5
ER -