TY - JOUR
T1 - A Study of the Validity of the New MCAT Exam
AU - Violato, Claudio
AU - Gauer, Jacqueline L.
AU - Violato, Efrem M.
AU - Patel, Dimple
N1 - Publisher Copyright:
© 2020 Lippincott Williams and Wilkins. All rights reserved.
PY - 2020/3/1
Y1 - 2020/3/1
N2 - Purpose To conduct a study of the validity of the new Medical College Admission Test (MCAT). Method Deidentified data for first- and second-year medical students (185 women, 54.3%; 156 men, 45.7%) who matriculated in 2016 and 2017 to the University of Minnesota Medical School-Twin Cities were included. Of those students, 220 (64.5%) had taken the new MCAT exam and 182 (53.4%) had taken the old MCAT exam (61 [17.9%] had taken both). The authors calculated descriptive statistics and Pearson product moment correlations (r) between new and old MCAT section scores. They conducteda regression analysis of MCAT section scores with Step 1 scores and with preclerkship course performance. They also conducted an exploratory factor analysis (principal component analysis with varimax rotation) of MCAT scores, undergraduate grade point average, Step 1 scores, and course performance. Results The new MCAT exam section mean score percentiles ranged from 72 to 78 (mean composite score percentile of 80). The old MCAT exam section mean score percentiles ranged from 84 to 88 (mean composite score percentile of 83). The pattern of correlations among and between new and old MCAT exam section scores (range of r: 0.03-0.67; P <.01) provided evidence of both divergent and convergent validities. Backward multiple regression of new MCAT exam section scores and Step 1 scores resulted in a multiple R of.440; the same analysis with Human Behavior course performance as the dependent variable provided a similar solution with the expected sections of the new MCAT exam (multiple R =.502). The factor analysis resulted in 4 cohesive, theoretically meaningful factors: biomedical knowledge, basic science concepts, cognitive reasoning, and general achievement. Conclusions This study provided empirical evidence of multiple types of validity for the new MCAT exam.
AB - Purpose To conduct a study of the validity of the new Medical College Admission Test (MCAT). Method Deidentified data for first- and second-year medical students (185 women, 54.3%; 156 men, 45.7%) who matriculated in 2016 and 2017 to the University of Minnesota Medical School-Twin Cities were included. Of those students, 220 (64.5%) had taken the new MCAT exam and 182 (53.4%) had taken the old MCAT exam (61 [17.9%] had taken both). The authors calculated descriptive statistics and Pearson product moment correlations (r) between new and old MCAT section scores. They conducteda regression analysis of MCAT section scores with Step 1 scores and with preclerkship course performance. They also conducted an exploratory factor analysis (principal component analysis with varimax rotation) of MCAT scores, undergraduate grade point average, Step 1 scores, and course performance. Results The new MCAT exam section mean score percentiles ranged from 72 to 78 (mean composite score percentile of 80). The old MCAT exam section mean score percentiles ranged from 84 to 88 (mean composite score percentile of 83). The pattern of correlations among and between new and old MCAT exam section scores (range of r: 0.03-0.67; P <.01) provided evidence of both divergent and convergent validities. Backward multiple regression of new MCAT exam section scores and Step 1 scores resulted in a multiple R of.440; the same analysis with Human Behavior course performance as the dependent variable provided a similar solution with the expected sections of the new MCAT exam (multiple R =.502). The factor analysis resulted in 4 cohesive, theoretically meaningful factors: biomedical knowledge, basic science concepts, cognitive reasoning, and general achievement. Conclusions This study provided empirical evidence of multiple types of validity for the new MCAT exam.
UR - http://www.scopus.com/inward/record.url?scp=85083875777&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85083875777&partnerID=8YFLogxK
U2 - 10.1097/ACM.0000000000003064
DO - 10.1097/ACM.0000000000003064
M3 - Article
C2 - 31702690
AN - SCOPUS:85083875777
SN - 1040-2446
VL - 95
SP - 396
EP - 400
JO - Academic Medicine
JF - Academic Medicine
IS - 3
ER -