Journal article
Effect of holistic review, interview blinding, and structured questions in resident selection: Can we predict who will do well in a residency interview?
Urology (Ridgewood, N.J.), Vol.173, pp.41-47
03/2023
DOI: 10.1016/j.urology.2022.11.047
PMID: 36603653
Abstract
To examine the Urology residency application process, particularly the interview. Historically, the residency interview has been vulnerable to bias and not determined to be a predictor of future residency performance. Our goal is to determine the relationship between pre-interview metrics and post-interview ranking using best practices for Urology resident selection including holistic review, blinded interviews, and structured behaviorally anchored questions.
Applications were assessed on cognitive (Alpha Omega Alpha [AOA], class rank [CR], junior year clinical clerkship [JYCC] grades) and noncognitive attributes (letters of recommendation [LOR], personal statement [PS], demographics, research, personal characteristics) by reviewers blinded to USMLE scores and photograph. Interviewers were blinded to the application other than PS and LORs. Interviews consisted of a structured behaviorally anchored question (SBI) and an unstructured interview (UI). Odds ratios were determined comparing pre-interview (PI) and interview impressions.
51 applicants were included in analysis. USMLE Step 1 score (avg 245) was associated with AOA, CR, JYCC, and PS. The UI score was associated with the LOR (p=0.04) whereas SBI scores were not (p=0.5). Faculty rank was associated with SBI, UI, and overall interview (OI) scores (p<0.001). Faculty rank was also associated with LOR. Resident impression of interviewees were associated with faculty interview scores (p=0.001) and faculty rank (p<0.001).
Traditional interviews may be biased toward application materials and may be balanced with behavioral questions. While Step 1 score does not offer additional information over other PI metrics, blinded interviews may offer discriminant validity over a pre-interview rubric.
Details
- Title: Subtitle
- Effect of holistic review, interview blinding, and structured questions in resident selection: Can we predict who will do well in a residency interview?
- Creators
- Paige De Rosa - University of Iowa Hospitals & Clinics, Department of UrologyElizabeth B Takacs - University of IowaLinder Wendt - University of Iowa, Department of StatisticsChad R Tracy - University of Iowa Hospitals & Clinics, Department of Urology. Electronic address: chad-tracy@uiowa.edu
- Resource Type
- Journal article
- Publication Details
- Urology (Ridgewood, N.J.), Vol.173, pp.41-47
- DOI
- 10.1016/j.urology.2022.11.047
- PMID
- 36603653
- ISSN
- 0090-4295
- eISSN
- 1527-9995
- Language
- English
- Electronic publication date
- 01/02/2023
- Date published
- 03/2023
- Academic Unit
- Radiology; Obstetrics and Gynecology; Urology
- Record Identifier
- 9984355660302771
Metrics
20 Record Views