Journal article
Evaluation using Cochran’s Q tests of the information content of individual items’ scores in the nurse anesthetist work habits instrument for use in providing feedback
Perioperative care and operating room management, Vol.40, 100519
09/2025
DOI: 10.1016/j.pcorm.2025.100519
Abstract
Annual ongoing professional practice evaluation (i.e., peer review) is mandatory for nurse anesthetists at many hospitals. A work habits instrument is a valid and psychometrically reliable tool for these high-stakes assessments. Our study focuses on item-specific feedback for nurse anesthetists to increase their scores.
The retrospective cohort study used all 9 complete academic years for which the studied department used the scale, July 2015 through June 2024. There were 59,863 evaluations of 713 nurse anesthetist years provided by 167 rating anesthesiologists, each evaluation with 6 non-Likert scored items from one to five.
The work habits instrument functioned as a binary (5 vs ≤4) multivariate (6-item) correlated (Cronbach alpha 0.96) array. Consequently, the 90% (53,626/59,863) of evaluations with all 6 items five, or all 6 items scored less than five, provided information about the nurse anesthetists' performance quality but no potentially useful item-specific information for feedback. Cochran Q tests were performed for each of the nurse anesthetist years using the remaining 10% of evaluations to look for items differing significantly from the other items. There were 4.6% (33/713) of nurse anesthetist years with adjusted P <0.05, representing 1.5% (911/59,863) of evaluations. The 4.6% did not differ from the nominal Type I error rate of 5% (P =0.73).
Providing analyses of individual item scores could benefit, at most, 5% of nurse anesthetists, likely fewer. Nurse anesthetists with low ongoing professional practice evaluations should have focused evaluation wholistically based on work habits.
Details
- Title: Subtitle
- Evaluation using Cochran’s Q tests of the information content of individual items’ scores in the nurse anesthetist work habits instrument for use in providing feedback
- Creators
- Franklin Dexter - Department of Anesthesia, University of IowaBradley J. Hindman - Department of Anesthesia, University of IowaKokila N. Thenuwara - Department of Anesthesia, University of Iowa
- Resource Type
- Journal article
- Publication Details
- Perioperative care and operating room management, Vol.40, 100519
- DOI
- 10.1016/j.pcorm.2025.100519
- ISSN
- 2405-6030
- eISSN
- 2405-6030
- Publisher
- Elsevier Inc
- Grant note
- Division of Management Consulting of the University of Iowa's Department of Anesthesia provides consultations
The authors declare the following financial interests/personal relationships which may be considered as potential competing interests: The Division of Management Consulting of the University of Iowa's Department of Anesthesia provides consultations to corporations, hospitals, and individuals. FD receives no funds personally other than his salary and allowable expense reimbursements from the University of Iowa and has tenure with no incentive program. He and his family have no financial holdings in any company related to his work other than indirectly through mutual funds for retirement. Income from the Di-vision's consulting work is used to fund Division research. A list of all the Division's consults is available in his posted curriculum vitae at http s://FranklinDexter.net/Contact_Info.htm. Dr. Dexter is on the editorial board of Perioperative Care and Operating Room Management. The other authors declare that they have no known competing financial in-terests or personal relationships that could have appeared to influence the work reported in this paper.
- Language
- English
- Electronic publication date
- 06/27/2025
- Date published
- 09/2025
- Academic Unit
- Anesthesia
- Record Identifier
- 9984843603402771
Metrics
2 Record Views