Journal article
Development, Usability, and Validity Evidence of a Rheumatology Telehealth Feedback Form
Arthritis care & research (2010), Vol.77(10), pp.1246-1253
10/2025
DOI: 10.1002/acr.25552
PMID: 40254905
Abstract
Objective
Rheumatology telehealth is widespread, making it essential that rheumatology fellows-in-training (FITs) achieve competence delivering telehealth care before entering the workforce. Feedback enhances telehealth skill development. This study develops a Rheumatology Telehealth Feedback Form (RTFF) that incorporates existing data and expertise as well as gathers validity evidence supporting its use.
Methods
The American College of Rheumatology Workforce Solutions Committee formed a Working Group with expertise in rheumatic diseases, telehealth, and medical education. The Working Group conducted a modified Delphi and focus groups to define content grounded in Rheumatology Telehealth Competencies and evidence-based practice as well as develop the RTFF. Rheumatology educators and FITs piloted the RTFF during patient care and simulated telehealth encounters, rating the helpfulness of the RTFF and providing data to calculate intraclass correlation coefficients (ICC).
Results
The modified Delphi identified 16 skills essential to conducting rheumatology telehealth encounters, which were converted into 17 items on the RTFF. Comment boxes prompted supplementary narrative. Five educators and ten FITs piloted the materials. All (5/5) “agreed” or “strongly agreed” that the RTFF helped teach rheumatology telehealth skills. ICCs calculated from two simulated telehealth encounters demonstrated moderately-to-strongly supportive interrater reliability (ICC=0.857 and 0.632).
Conclusion
The RTFF incorporates evidence-based, expert consensus of the skills most essential for rheumatology telehealth encounters. Educators can use the RTFF as a guide for observing FITs delivering telehealth care, providing formative feedback, and helping FITs develop their skills before entering the workforce. The RTFF is the first direct observation formative assessment tool designed for teaching rheumatology telehealth skills.
Details
- Title: Subtitle
- Development, Usability, and Validity Evidence of a Rheumatology Telehealth Feedback Form
- Creators
- Lisa Zickuhr - Washington University in St. Louis School of MedicineAlberto Sobrero - Washington University in St. Louis School of MedicineDaniel Albert - Dartmouth CollegeAmanda S. Alexander - University of Alabama at BirminghamTami Bonnett-Ami - 3GEM Consulting Washington DCSarah Dill - Lakeview Rheumatology Yakima WASharon Dowell - NEA Baptist Memorial HospitalElizabeth D. Ferucci - Alaska Native Tribal Health ConsortiumConnie Herndon - American College of RheumatologyBharat Kumar - University of Iowa Carver College of Medicine Iowa City IADavid Leverenz - Duke University School of MedicineJennifer Mandal - University of California - San Francisco School of MedicineAmaad Rana - Yale School of MedicineIrene J. Tan - Thomas Jefferson University HospitalSwamy Venuturupalli - Cedars-Sinai Medical CenterTiffany Westrich-Robertson - International Foundation for Autoimmune & Autoinflammatory Arthritis (AiArthritis), St. Louis MOMarcy B. Bolster - Massachusetts General HospitalJason Kolfenbach - University of Colorado Anschutz Medical CampusAmerican College of Rheumatology Workforce Solutions Committee
- Resource Type
- Journal article
- Publication Details
- Arthritis care & research (2010), Vol.77(10), pp.1246-1253
- DOI
- 10.1002/acr.25552
- PMID
- 40254905
- NLM abbreviation
- Arthritis Care Res (Hoboken)
- ISSN
- 2151-464X
- eISSN
- 2151-4658
- Publisher
- WILEY
- Grant note
- Pfizer
We thank the educators and rheumatology fellows-in-training who piloted the Rheumatology Telehealth Feedback Form.
- Language
- English
- Electronic publication date
- 04/20/2025
- Date published
- 10/2025
- Academic Unit
- Immunology; Internal Medicine
- Record Identifier
- 9984813172202771
Metrics
2 Record Views