The role of academic achievements and psychometric measures in the ranking process.

Introduction: Ranking candidates for residency positions is challenging. We hypothesize that applicant academic achievements and performance during the interview are equally important in the ranking process.

Methods: This is a retrospective study. Of 53 candidates interviewed during 2016-2017 cycle, 44 (83%) were ranked for 3 PGY1 positions. Each candidate was interviewed and scored in each of the following: USMLE Step 1 score, USMLE Step 2 score, research (RS), letters of recommendation (LOR), personal statement (PS), the way the candidate represented him/herself (RP), interest in the area (IN), answers to standardized questions (SQ), and degree of connection between the candidate and the interviewer (CN).

Results: Correlation and multiple regression analyses indicated an inverse relationship between ranking the candidates and USMLE2 (r = -0.14, p = -0.364), LOR (r = -0.513, p < 0.001), PS (r = -0.414, p = 0.006), RP (r = -0.485, p = 0.001), CN (r = -0.605, p < 0.001), IN (r = -0.349, p = 0.022), and SQ (r = -0.480, p = 0.001), USMLE1 (r = -0.036, p = 0.838) and RS (r = -0.008, p = 0.96). After controlling for the other variables, only CN reached statistical significance (p = 0.033).

Conclusion: Candidate non-cognitive measures during the interview weigh higher than academic performance in the ranking process.