Journal article
Web-Enabled Mechanistic Case Diagramming: A Novel Tool for Assessing Students' Ability to Integrate Foundational and Clinical Sciences
Academic medicine, Vol.93(8), pp.1146-1149
08/01/2018
DOI: 10.1097/ACM.0000000000002184
PMID: 29465452
Abstract
Problem
As medical schools move from discipline-based courses to more integrated approaches, identifying assessment tools that parallel this change is an important goal.
Approach
The authors describe the use of test item statistics to assess the reliability and validity of web-enabled mechanistic case diagrams (MCDs) as a potential tool to assess students' ability to integrate basic science and clinical information. Students review a narrative clinical case and construct an MCD using items provided by the case author. Students identify the relationships among underlying risk factors, etiology, pathogenesis and pathophysiology, and the patients' signs and symptoms. They receive one point for each correctly identified link.
Outcomes
In 2014-2015 and 2015-2016, case diagrams were implemented in consecutive classes of 150 medical students. The alpha reliability coefficient for the overall score, constructed using each student's mean proportion correct across all cases, was 0.82. Discrimination indices for each of the case scores with the overall score ranged from 0.23 to 0.51. In a G study using those students with complete data (n = 251) on all 16 cases, 10% of the variance was true score variance, and systematic case variance was large. Using 16 cases generated a G coefficient (relative score reliability) equal to 0.72 and a Phi equal to 0.65.
Next Steps
The next phase of the project will involve deploying MCDs in higher-stakes settings to determine whether similar results can be achieved. Further analyses will determine whether these assessments correlate with other measures of higher-order thinking skills.
Details
- Title: Subtitle
- Web-Enabled Mechanistic Case Diagramming: A Novel Tool for Assessing Students' Ability to Integrate Foundational and Clinical Sciences
- Creators
- Kristi J. Ferguson - Roy J. and Lucille A. Carver College of MedicineClarence D. Kreiter - Roy J. and Lucille A. Carver College of MedicineThomas H. Haugen - Roy J. and Lucille A. Carver College of MedicineFred R. Dee - Univ Iowa, Vet Adm Med Ctr, Carver Coll Med, Pathol & Lab Serv, Iowa City, IA USA
- Resource Type
- Journal article
- Publication Details
- Academic medicine, Vol.93(8), pp.1146-1149
- Publisher
- Lippincott Williams & Wilkins
- DOI
- 10.1097/ACM.0000000000002184
- PMID
- 29465452
- ISSN
- 1040-2446
- eISSN
- 1938-808X
- Number of pages
- 4
- Grant note
- Stemmler Fund, National Board of Medical Exaininers (Philadelphia, Pennsylvania)
- Language
- English
- Date published
- 08/01/2018
- Academic Unit
- Pathology; Family and Community Medicine; General Internal Medicine; Internal Medicine
- Record Identifier
- 9984297442302771
Metrics
2 Record Views