Journal article
Use of the Behavior Assessment Tool in 18 Pilot Residency Programs
JB & JS open access, Vol.5(4), p.e20.00103
10/2020
DOI: 10.2106/JBJS.OA.20.00103
PMCID: PMC7682982
PMID: 33244509
Abstract
The purpose of this study was to determine the feasibility and evaluate the effectiveness of the American Board of Orthopaedic Surgery Behavior Tool (ABOSBT) for measuring professionalism.
Through collaboration between the American Board of Orthopaedic Surgery and American Orthopaedic Association's Council of Residency Directors, 18 residency programs piloted the use of the ABOSBT. Residents requested assessments from faculty at the end of their clinical rotations, and a 360° request was performed near the end of the academic year. Program Directors (PDs) rated individual resident professionalism (based on historical observation) at the outset of the study, for comparison to the ABOSBT results.
Nine thousand eight hundred ninety-two evaluations were completed using the ABOSBT for 449 different residents by 1,012 evaluators. 97.6% of all evaluations were scored level 4 or 5 (high levels of professional behavior) across all of the 5 domains. In total, 2.4% of all evaluations scored level 3 or below reflecting poorer performance. Of 431 residents, the ABOSBT identified 26 of 32 residents who were low performers (2 or more < level 3 scores in a domain) and who also scored "below expectations" by the PD at the start of the pilot project (81% sensitivity and 57% specificity), including 13 of these residents scoring poorly in all 5 domains. Evaluators found the ABOSBT was easy to use (96%) and that it was an effective tool to assess resident professional behavior (81%).
The ABOSBT was able to identify 2.4% low score evaluations (<level 3) for all residents. The tool was concordant with the PD for 81% of the residents considered low performers or "outliers" for professional behavior. The 5-domain construct makes it an effective actionable tool that can be used to help develop performance improvement plans for residents.
Level II.
Details
- Title: Subtitle
- Use of the Behavior Assessment Tool in 18 Pilot Residency Programs
- Creators
- April D Armstrong - Penn State Milton S. Hershey Medical CenterJulie Agel - Harborview Medical CenterMatthew D Beal - Department of Orthopaedic Surgery, North Western University, Chicago, Illinois.Michael S Bednar - Loyola University Medical CenterMichelle S Caird - University of Michigan–Ann ArborJames E Carpenter - Department of Orthopaedic Surgery, Sports Medicine, Med Sport, Ann Arbor, Michigan.Stuart T Guthrie - Henry Ford HospitalPaul Juliano - Penn State Milton S. Hershey Medical CenterMatthew Karam - University of IowaDawn LaPorte - Department of Orthopaedic Surgery, Johns Hopkins Medicine, Baltimore, Maryland.J Lawrence Marsh - University of IowaJoshua C Patt - CMC Orthopaedic Surgery, University of North Carolina School of Medicine, Charlotte, North Carolina.Terrance D Peabody - Department of Orthopaedic Surgery, North Western University, Chicago, Illinois.Karen Wu - Loyola University Medical CenterDavid F Martin - Wake Forest Baptist Medical CenterJohn J Harrast - Data HarborAnn E Van Heest - University of Minnesota
- Resource Type
- Journal article
- Publication Details
- JB & JS open access, Vol.5(4), p.e20.00103
- DOI
- 10.2106/JBJS.OA.20.00103
- PMID
- 33244509
- PMCID
- PMC7682982
- NLM abbreviation
- JB JS Open Access
- ISSN
- 2472-7245
- eISSN
- 2472-7245
- Language
- English
- Date published
- 10/2020
- Academic Unit
- Orthopedics and Rehabilitation
- Record Identifier
- 9984304685802771
Metrics
10 Record Views