Journal article
Alert design in the real world: a cross-sectional analysis of interruptive alerting at 9 academic pediatric health systems
Journal of the American Medical Informatics Association : JAMIA, Vol.32(4), pp.682-688
04/01/2025
DOI: 10.1093/jamia/ocaf013
PMCID: PMC12005624
PMID: 39903167
Abstract
To assess the prevalence of recommended design elements in implemented electronic health record (EHR) interruptive alerts across pediatric care settings.
We conducted a 3-phase mixed-methods cross-sectional study. Phase 1 involved developing a codebook for alert content classification. Phase 2 identified the most frequently interruptive alerts at participating sites. Phase 3 applied the codebook to classify alerts. Inter-rater reliability (IRR) for the codebook and descriptive statistics for alert design contents were reported.
We classified alert content on design elements such as the rationale for the alert's appearance, the hazard of ignoring it, directive versus informational content, administrative purpose, and whether it aligned with one of the Institute of Medicine's (IOM) domains of healthcare quality. Most design elements achieved an IRR above 0.7, with the exceptions for identifying directive content outside of an alert (IRR 0.58) and whether an alert was for administrative purposes only (IRR 0.36). IRR was poor for all IOM domains except equity. Institutions varied widely in the number of unique alerts and their designs. 78% of alerts stated their purpose, over half were directive, and 13% were informational. Only 2%-20% of alerts explained the consequences of inaction.
This study raises important questions about the optimal balance of alert functions and desirable features of alert representation.
Our study provides the first multi-center analysis of EHR alert design elements in pediatric care settings, revealing substantial variation in content and design. These findings underline the need for future research to experimentally explore EHR alert design best practices to improve efficiency and effectiveness.
Details
- Title: Subtitle
- Alert design in the real world: a cross-sectional analysis of interruptive alerting at 9 academic pediatric health systems
- Creators
- Swaminathan Kandaswamy - Emory UniversityJulia K W Yarahuan - Children's Healthcare of AtlantaElizabeth A Dobler - Lurie Children's HospitalMatthew J Molloy - Cincinnati Children's Hospital Medical CenterLindsey A Knake - University of IowaSean M Hernandez - Wake Forest UniversityAnne A Fallon - University of Rochester Medical CenterLauren M Hess - Baylor College of MedicineAllison B McCoy - Vanderbilt University Medical CenterRegine M Fortunov - Baylor College of MedicineEric S Kirkendall - Wake Forest UniversityNaveen Muthu - Children's Healthcare of AtlantaEvan W Orenstein - Children's Healthcare of AtlantaAdam C Dziorny - University of Rochester Medical CenterJuan D Chaparro - Nationwide Children's Hospital
- Resource Type
- Journal article
- Publication Details
- Journal of the American Medical Informatics Association : JAMIA, Vol.32(4), pp.682-688
- DOI
- 10.1093/jamia/ocaf013
- PMID
- 39903167
- PMCID
- PMC12005624
- NLM abbreviation
- J Am Med Inform Assoc
- ISSN
- 1067-5027
- eISSN
- 1527-974X
- Publisher
- OXFORD UNIV PRESS
- Language
- English
- Electronic publication date
- 02/04/2025
- Date published
- 04/01/2025
- Academic Unit
- Stead Family Department of Pediatrics; Neonatology
- Record Identifier
- 9984786308502771
Metrics
21 Record Views