TY - JOUR
T1 - A construct validity study of clinical competence
T2 - A multitrait multimethod matrix approach
AU - Baig, Lubna
AU - Violato, Claudio
AU - Crutcher, Rodney
PY - 2010/12
Y1 - 2010/12
N2 - Introduction: The purpose of the study was to adduce evidence for estimating the construct validity of clinical competence measured through assessment instruments used for high-stakes examinations. Methods: Thirty-nine international physicians (mean age = 41 + 6.5 y) participated in high-stakes examination and 3-month supervised clinical practice to determine the practice readiness of physicians. Three traits-doctor-patient relationship, clinical competence, and communication skills-were assessed with objective structured clinical examinations, in-training evaluation reports, and clinical assessments. These traits were intercorrelated in a multitrait multimethod matrix (MTMM). Results: The reliability of assessments ranged from moderate to high (Cronbach's α: 0.58-0.98; Ep 2 = 0.79). There is evidence for both convergent and divergent validity for clinical competence, followed by doctor-patient relationships, and communications (validity coefficients = 0.12-0.85). The correlations between the same methods but different traits indicate that there is substantial method specificity in the assessment accounting for nearly one-quarter of the variance (23.7%). Discussion: There is evidence for the construct validity of all 3 traits across 3 methods. The MTMM approach, currently underutilized, could be used to estimate the degree of evidence for validating complex constructs, such as clinical competence.
AB - Introduction: The purpose of the study was to adduce evidence for estimating the construct validity of clinical competence measured through assessment instruments used for high-stakes examinations. Methods: Thirty-nine international physicians (mean age = 41 + 6.5 y) participated in high-stakes examination and 3-month supervised clinical practice to determine the practice readiness of physicians. Three traits-doctor-patient relationship, clinical competence, and communication skills-were assessed with objective structured clinical examinations, in-training evaluation reports, and clinical assessments. These traits were intercorrelated in a multitrait multimethod matrix (MTMM). Results: The reliability of assessments ranged from moderate to high (Cronbach's α: 0.58-0.98; Ep 2 = 0.79). There is evidence for both convergent and divergent validity for clinical competence, followed by doctor-patient relationships, and communications (validity coefficients = 0.12-0.85). The correlations between the same methods but different traits indicate that there is substantial method specificity in the assessment accounting for nearly one-quarter of the variance (23.7%). Discussion: There is evidence for the construct validity of all 3 traits across 3 methods. The MTMM approach, currently underutilized, could be used to estimate the degree of evidence for validating complex constructs, such as clinical competence.
KW - Clinical competence
KW - Construct validity
KW - International medical graduates (IMGs)
KW - Multitrait multimethod matrix
KW - Practice readiness
UR - http://www.scopus.com/inward/record.url?scp=77954109668&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77954109668&partnerID=8YFLogxK
U2 - 10.1002/chp.20052
DO - 10.1002/chp.20052
M3 - Article
C2 - 20222031
AN - SCOPUS:77954109668
SN - 0894-1912
VL - 30
SP - 19
EP - 25
JO - Journal of Continuing Education in the Health Professions
JF - Journal of Continuing Education in the Health Professions
IS - 1
ER -