Logo image
Back
Fluoroscopic image-based behavior analysis can objectively explain subjective expert assessment of wire navigation skill
Journal article   Open access   Peer reviewed

Fluoroscopic image-based behavior analysis can objectively explain subjective expert assessment of wire navigation skill

Dominik D Mattioli, Geb W Thomas, Steven Long, Jan Duedal Rölfing and Donald D Anderson
Journal of orthopaedic research, Vol.42(2), pp.404-414
02/2024
DOI: 10.1002/jor.25685
PMCID: PMC11984805
PMID: 37652571
Appears in  UI Libraries Support Open Access
url
https://doi.org/10.1002/jor.25685View
Published (Version of record) Open Access

Related content

Has accepted manuscript

Abstract

Psychomotor skill and decision-making efficiency in surgical wire navigation can be objectively evaluated by analysis of intraoperative fluoroscopic image sequences. Prior work suggests that such image-based behavior analysis of operating room (OR) performance can predict performer experience level (R2 = 0.62) and agree with expert opinion (the current standard) on the quality of a final implant construct (R2 = 0.59). However, it is unclear how objective image-based evaluation compares with expert assessments for entire technical OR performances. This study examines the relationships between three key variables: (1) objective image-based criteria, (2) expert opinions, and (3) performing surgeon experience level. A paired-comparison survey of seven experts done based upon eight OR fluoroscopic wire navigation sequences shows that the experts’ preferences are best explained by objective metrics that reflect psychomotor and decision-making behaviors which are counter-productive to successful implant placement, like image count (R2 = 0.83) and behavior tally (R2 = 0.74). One such behavior, adjustments away from goal, uniquely correlated well with all three key variables: the fluoroscopic image-based analysis composite score (R2 = 0.40), expert consensus (R2 = 0.76), and performer experience (R2 = 0.41). These results confirm that experts view less efficient technical behavior as indicative of lesser technical proficiency. However, while expert assessments of technical skill were reliable and consistent, neither individual nor consensus expert opinion appears to correlate with performer experience (R2 = 0.11).
 expert opinion flouroscopic image analysis paired comparison surgical data science technical skill assessment UIOWA OA Agreement

Details

Metrics

58 Record Views
Logo image