Journal article
RE-AIM for rural health innovations: perceptions of (mis) alignment between the RE-AIM framework and evaluation reporting in the Department of Veterans Affairs Enterprise-Wide Initiatives program
Frontiers in health services, Vol.4, 1278209
04/01/2024
DOI: 10.3389/frhs.2024.1278209
PMCID: PMC11035780
PMID: 38655394
Abstract
BackgroundThe Department of Veterans Affairs (VA) Office of Rural Health (ORH) supports national VA program offices' efforts to expand health care to rural Veterans through its Enterprise-Wide Initiatives (EWIs) program. In 2017, ORH selected Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM), an implementation science framework, to structure the EWI evaluation and reporting process. As part of its mandate to improve EWI program evaluation, the Center for the Evaluation of Enterprise-Wide Initiatives conducted a qualitative evaluation to better understand EWI team' perceptions of, and barriers and facilitators to, the EWI evaluation process.MethodsWe conducted 43 semi-structured interviews with 48 team members (e.g., evaluators, program office leads, and field-based leads) representing 21 EWIs from April-December 2020. Questions focused on participants' experiences using strategies targeting each RE-AIM dimension. Interviews were inductively analyzed in MAXQDA. We also systematically reviewed 51 FY19-FY20 EWI annual reports to identify trends in misapplications of RE-AIM.ResultsParticipants had differing levels of experience with RE-AIM. While participants understood ORH's rationale for selecting a common framework to structure evaluations, the perceived misalignment between RE-AIM and EWIs' work emerged as an important theme. Concerns centered around 3 sub-themes: (1) (Mis)Alignment with RE-AIM Dimensions, (2) (Mis)Alignment between RE-AIM and the EWI, and (3) (Mis)Alignment with RE-AIM vs. other Theories, Models, or Frameworks. Participants described challenges differentiating between and operationalizing dimensions in unique contexts. Participants also had misconceptions about RE-AIM and its relevance to their work, e.g., that it was meant for established programs and did not capture aspects of initiative planning, adaptations, or sustainability. Less commonly, participants shared alternative models or frameworks to RE-AIM. Despite criticisms, many participants found RE-AIM useful, cited training as important to understanding its application, and identified additional training as a future need.DiscussionThe selection of a shared implementation science framework can be beneficial, but also challenging when applied to diverse initiatives or contexts. Our findings suggest that establishing a common understanding, operationalizing framework dimensions for specific programs, and assessing training needs may better equip partners to integrate a shared framework into their evaluations.
Details
- Title: Subtitle
- RE-AIM for rural health innovations: perceptions of (mis) alignment between the RE-AIM framework and evaluation reporting in the Department of Veterans Affairs Enterprise-Wide Initiatives program
- Creators
- Emily E. Chasco - University of IowaJennifer Van Tiem - Iowa City VA Health Care SystemNicole Johnson - Center for Access and Delivery Research and Evaluation, Iowa City VA Healthcare System, Iowa City, IA, United StatesErin Balkenende - Iowa City VA Health Care SystemMelissa Steffen - Iowa City VA Health Care SystemDeShauna Jones - University of IowaJulia E. Friberg - Iowa City VA Health Care SystemKenda Steffensmeier - Center for Access and Delivery Research and Evaluation, Iowa City VA Healthcare System, Iowa City, IA, United StatesJane Moeckli - Iowa City VA Health Care SystemKanika Arora - University of IowaBorsika Adrienn Rabin - University of California San DiegoHeather Schacht Reisinger - University of Iowa
- Resource Type
- Journal article
- Publication Details
- Frontiers in health services, Vol.4, 1278209
- DOI
- 10.3389/frhs.2024.1278209
- PMID
- 38655394
- PMCID
- PMC11035780
- NLM abbreviation
- Front Health Serv
- ISSN
- 2813-0146
- Publisher
- Frontiers Media S.A
- Language
- English
- Date published
- 04/01/2024
- Academic Unit
- Health Management and Policy; Center for Social Science Innovation; Injury Prevention Research Center; Institute for Clinical and Translational Science; Internal Medicine
- Record Identifier
- 9984617004802771
Metrics
12 Record Views