Journal article
Design and Evaluation Challenges of Conversational Agents in Health Care and Well-being: Selective Review Study
Journal of medical Internet research, Vol.24(11), pp.e38525-e38525
11/15/2022
DOI: 10.2196/38525
PMCID: PMC9709676
PMID: 36378515
Abstract
Background: Health care and well-being are 2 main interconnected application areas of conversational agents (CAs). There is a significant increase in research, development, and commercial implementations in this area. In parallel to the increasing interest, new challenges in designing and evaluating CAs have emerged.
Objective: This study aims to identify key design, development, and evaluation challenges of CAs in health care and well-being research. The focus is on the very recent projects with their emerging challenges.
Methods: A review study was conducted with 17 invited studies, most of which were presented at the ACM (Association for Computing Machinery) CHI 2020 conference workshop on CAs for health and well-being. Eligibility criteria required the studies to involve a CA applied to a health or well-being project (ongoing or recently finished). The participating studies were asked to report on their projects' design and evaluation challenges. We used thematic analysis to review the studies.
Results: The findings include a range of topics from primary care to caring for older adults to health coaching. We identified 4 major themes: (1) Domain Information and Integration, (2) User-System Interaction and Partnership, (3) Evaluation, and (4) Conversational Competence.
Conclusions: CAs proved their worth during the pandemic as health screening tools, and are expected to stay to further support various health care domains, especially personal health care. Growth in investment in CAs also shows the value as a personal assistant. Our study shows that while some challenges are shared with other CA application areas, safety and privacy remain the major challenges in the health care and well-being domains. An increased level of collaboration across different institutions and entities may be a promising direction to address some of the major challenges that otherwise would be too complex to be addressed by the projects with their limited scope and budget. (J Med Internet Res 2022;24(11):e38525) doi: 10.2196/38525
Details
- Title: Subtitle
- Design and Evaluation Challenges of Conversational Agents in Health Care and Well-being: Selective Review Study
- Creators
- Ahmet Baki Kocaballi - University of Technology SydneyEmre Sezgin - Nationwide Childrens Hosp, Abigail Wexner Res Inst, Ctr Biobehav Hlth, Columbus, OH USALeigh Clark - Insight HealthcareJohn M. Carroll - Pennsylvania State UniversityYungui Huang - Nationwide Children's HospitalJina Huh-Yoo - Drexel UniversityJunhan Kim - University of Michigan–Ann ArborRafal Kocielnik - California Institute of TechnologyYi-Chieh Lee - Natl Univ Singapore, Dept Comp Sci, Singapore City, SingaporeLena Mamykina - Columbia UniversityElliot G. Mitchell - Geisinger Health SystemRobert J. Moore - IBM Research - AlmadenPrasanth Murali - Northeastern UniversityElizabeth D. Mynatt - Northeastern UniversitySun Young Park - University of Michigan–Ann ArborAlessandro Pasta - Technical University of DenmarkDeborah Richards - Macquarie UniversityLucas M. Silva - University of California, IrvineDiva Smriti - Drexel UniversityBrendan Spillane - University College DublinZhan Zhang - Pace UniversityTamara Zubatiy - Georgia Institute of Technology
- Resource Type
- Journal article
- Publication Details
- Journal of medical Internet research, Vol.24(11), pp.e38525-e38525
- Publisher
- Jmir Publications, Inc
- DOI
- 10.2196/38525
- PMID
- 36378515
- PMCID
- PMC9709676
- ISSN
- 1438-8871
- eISSN
- 1438-8871
- Number of pages
- 15
- Language
- English
- Date published
- 11/15/2022
- Academic Unit
- Computer Science
- Record Identifier
- 9984696568702771
Metrics
5 Record Views