Journal article
An Investigation of the Generalizability of Medical School Grades
Teaching and learning in medicine, Vol.28(3), pp.279-285
01/01/2016
DOI: 10.1080/10401334.2016.1154859
PMID: 27092723
Abstract
Construct/Background: Medical school grades are currently unstandardized, and their level of reliability is unknown. This means their usefulness for reporting on student achievement is also not well documented. This study investigates grade reliability within 1 medical school. Approach: Generalizability analyses are conducted on grades awarded. Grades from didactic and clerkship-based courses were treated as 2 levels of a fixed facet within a univariate mixed model. Grades from within the 2 levels (didactic and clerkship) were also entered in a multivariate generalizability study. Results: Grades from didactic courses were shown to produce a highly reliable mean score (G = .79) when averaged over as few as 5 courses. Although the universe score correlation between didactic and clerkship courses was high (r = .80), the clerkship courses required almost twice as many grades to reach a comparable level of reliability. When grades were converted to a Pass/Fail metric, almost all information contained in the grades was lost. Conclusions: Although it has been suggested that the imprecision of medical school grades precludes their use as a reliable indicator of student achievement, these results suggest otherwise. While it is true that a Pass/Fail system of grading provides very little information about a student's level of performance, a multi-tiered grading system was shown to be a highly reliable indicator of student achievement within the medical school. Although grades awarded during the first 2 didactic years appear to be more reliable than clerkship grades, both yield useful information about student performance within the medical college.
Details
- Title: Subtitle
- An Investigation of the Generalizability of Medical School Grades
- Creators
- Clarence D. Kreiter - Roy J. and Lucille A. Carver College of MedicineKristi J. Ferguson - Roy J. and Lucille A. Carver College of Medicine
- Resource Type
- Journal article
- Publication Details
- Teaching and learning in medicine, Vol.28(3), pp.279-285
- Publisher
- Taylor & Francis
- DOI
- 10.1080/10401334.2016.1154859
- PMID
- 27092723
- ISSN
- 1040-1334
- eISSN
- 1532-8015
- Number of pages
- 7
- Language
- English
- Date published
- 01/01/2016
- Academic Unit
- Family and Community Medicine; General Internal Medicine; Internal Medicine
- Record Identifier
- 9984297440702771
Metrics
14 Record Views