Minimally trained analysts can perform fast, objective assessment of orthopedic technical skill from fluoroscopic images

Dominik D. Mattioli; Geb W. Thomas; Steven A. Long; Marcus Tatum; Donald D. Anderson

doi:10.1080/24725579.2022.2035022

Back

Minimally trained analysts can perform fast, objective assessment of orthopedic technical skill from fluoroscopic images

Journal article

Peer reviewed

Minimally trained analysts can perform fast, objective assessment of orthopedic technical skill from fluoroscopic images

Dominik D. Mattioli, Geb W. Thomas, Steven A. Long, Marcus Tatum and Donald D. Anderson

IISE transactions on healthcare systems engineering, Vol.12(3), pp.212-220

08/15/2022

DOI: 10.1080/24725579.2022.2035022

PMCID: PMC9488091

PMID: 36147899

Files and links (1)

url

https://www.ncbi.nlm.nih.gov/pmc/articles/9488091View

Open Access

Abstract

Skill assessment in orthopedics has traditionally relied on subjective impressions from a supervising surgeon. The feedback derived from these tools may be limited by bias and practical issues. Objective analysis of intraoperative fluoroscopic images offers an inexpensive and easily repeatable assessment strategy without bias. Despite the advantages, surgeon mentors generally refrain from using the scores of images obtained throughout an operation to evaluate a performer's technical skill because of other practical constraints. A new system was designed to rapidly facilitate objective analysis of fluoroscopy using minimally trained analysts. Four expert and four novice analysts independently measured one objective metric of orthopedic technical skill using both a custom analysis software and a commercial alternative. Novice analysts using the custom software produced measurements three times faster than experts using the commercial software without a practical difference in annotation error. Expert analysts leveraged the custom software automation features to further improve their measurements. These results suggest that a well-designed fluoroscopy analysis system can facilitate regular, practical, and objective assessment of orthopedic technical skill.

fluoroscopic image analysis

objective skills assessment

Orthopedics

process improvement

surgical data science

Details

Title: Subtitle: Minimally trained analysts can perform fast, objective assessment of orthopedic technical skill from fluoroscopic images
Creators: Dominik D. Mattioli - University of Iowa
Geb W. Thomas - University of Iowa
Steven A. Long - University of Iowa
Marcus Tatum - University of Iowa
Donald D. Anderson - University of Iowa
Resource Type: Journal article
Publication Details: IISE transactions on healthcare systems engineering, Vol.12(3), pp.212-220
DOI: 10.1080/24725579.2022.2035022
PMID: 36147899
PMCID: PMC9488091
NLM abbreviation: IISE Trans Healthc Syst Eng
ISSN: 2472-5579
eISSN: 2472-5587
Publisher: Taylor & Francis
Grant note: name: Pediatric Orthopedic Society of North America, award: R18HS025353; DOI: 10.13039/100000133, name: Agency for Healthcare Research and Quality
Language: English
Date published: 08/15/2022
Academic Unit: Roy J. Carver Department of Biomedical Engineering; Orthopedics and Rehabilitation; Industrial and Systems Engineering
Record Identifier: 9984303974102771

Metrics

60 Record Views

2 Times Cited - Web of Science