Logo image
Towards Multidisciplinary Summarization of Hospital Stays: Efficient Sentence-Level Clinical Section Categorization
Book chapter

Towards Multidisciplinary Summarization of Hospital Stays: Efficient Sentence-Level Clinical Section Categorization

Baris Karacan, Vaibhav Bhargava, Barbara Di Eugenio, Natalie Parde, Mary Khetani, Yu-Shan Tseng, Vanessa Barbosa, Julie Vignato, Lindsey Knake, Rajashree Dahal, …
Artificial Intelligence in Medicine, pp.383-388
Lecture Notes in Computer Science, v. 16749, Springer Nature Switzerland
2026
DOI: 10.1007/978-3-032-30813-9_71

View Online

Abstract

Effective “all-team” summarization in high-complexity settings like the Neonatal Intensive Care Unit (NICU) requires aggregating insights from diverse disciplines (physicians, nurses, therapists) spread across hundreds of clinical free-text notes. Simply pooling heterogeneous text often leads to incoherent outputs. Structured summarization therefore first requires accurate categorization of sentence-level section labels across multi-source notes. This pilot study introduces a clinical section categorization pipeline using supervised fine-tuning (SFT) of large language models (LLMs). We adapted two Llama-3 models (8B and 70B) to MedSecId, a corpus of 2,002 MIMIC-III (Adult ICU) notes annotated with clinical section headers, achieving in-domain Macro F1 scores above 92% for both models. To evaluate cross-domain generalization, we assessed model capacity (8B vs. 70B) and quantization on a gold-standard dataset of 227 sentence-level spans derived from three multidisciplinary NICU summaries. Experimental results suggest a potential scale-dependent transfer effect: while SFT produced only marginal changes for the 8B model, it substantially improved the 70B model, increasing Macro F1 by 7%. Notably, the quantized fine-tuned 70B model outperformed its full-precision baseline while substantially reducing computational requirements. These findings suggest that sufficient model capacity is critical for preserving semantic flexibility during cross-domain clinical transfer and that efficient quantized adaptation can enable structured section-label modeling for downstream summarization.
Clinical NLP Clinical Section Categorization Large Language Models Supervised Fine-Tuning

Details

Metrics

1 Record Views
Logo image