Preprint
The HaLLMark Effect: Supporting Provenance and Transparent Use of Large Language Models in Writing with Interactive Visualization
arXiv.org
Cornell University
11/21/2023
DOI: 10.48550/arxiv.2311.13057
Abstract
The use of Large Language Models (LLMs) for writing has sparked controversy both among readers and writers. On one hand, writers are concerned that LLMs will deprive them of agency and ownership, and readers are concerned about spending their time on text generated by soulless machines. On the other hand, AI-assistance can improve writing as long as writers can conform to publisher policies, and as long as readers can be assured that a text has been verified by a human. We argue that a system that captures the provenance of interaction with an LLM can help writers retain their agency, conform to policies, and communicate their use of AI to publishers and readers transparently. Thus we propose HaLLMark, a tool for visualizing the writer's interaction with the LLM. We evaluated HaLLMark with 13 creative writers, and found that it helped them retain a sense of control and ownership of the text.
Details
- Title: Subtitle
- The HaLLMark Effect: Supporting Provenance and Transparent Use of Large Language Models in Writing with Interactive Visualization
- Creators
- Md Naimul HoqueTasfia MashiatBhavya GhaiCecilia SheltonFanny ChevalierKari KrausNiklas Elmqvist
- Resource Type
- Preprint
- Publication Details
- arXiv.org
- Publisher
- Cornell University
- DOI
- 10.48550/arxiv.2311.13057
- Language
- English
- Date posted
- 11/21/2023
- Academic Unit
- Computer Science
- Record Identifier
- 9984787447402771
Metrics
1 Record Views