Exploring Opportunities for Multimodality and Multiple Devices in Food Journaling

Lucas M. Silva; Elizabeth A. Ankrah; Yuqi Huai; Daniel A. Epstein

doi:10.1145/3604256

Back

Exploring Opportunities for Multimodality and Multiple Devices in Food Journaling

Journal article

Open access

Peer reviewed

Exploring Opportunities for Multimodality and Multiple Devices in Food Journaling

Lucas M. Silva, Elizabeth A. Ankrah, Yuqi Huai and Daniel A. Epstein

Proceedings of the ACM on human-computer interaction, Vol.7(MHCI), pp.1-27

09/12/2023

DOI: 10.1145/3604256

Files and links (1)

url

https://doi.org/10.1145/3604256View

Published (Version of record) Open Access

Abstract

Digital food journaling can support personal goals, such as weight loss and developing healthy eating behaviors. However, traditional manual tracking demands great effort, often leading to lapses or abandonment. We explore opportunities for journaling with multiple input modalities and devices, leveraging people's daily interactions with a range of technologies. We report on an extended analysis of 15 participants' experiences with ModEat, a prototype supporting journaling with several input modalities on phone, computer, and voice assistants. Participants' modality and device preferences were largely influenced by their goals, but they frequently deviated from those preferences depending on device availability, perceived affordances, and characteristics of foods eaten. Participants rarely combined input modalities in entries, but some described that doing so allowed for more detailed journaling or serve as a placeholder for later. We discuss advantages and drawbacks of multimodal tracking and potential strategies for improving interactions.

HCI design and evaluation methods

Human computer interaction (HCI)

Human-centered computing

Mobile devices

Ubiquitous and mobile computing

Ubiquitous and mobile devices

User studies

Details

Title: Subtitle: Exploring Opportunities for Multimodality and Multiple Devices in Food Journaling
Creators: Lucas M. Silva - University of California, Irvine
Elizabeth A. Ankrah - University of California, Irvine
Yuqi Huai - University of California, Irvine
Daniel A. Epstein - University of California, Irvine
Resource Type: Journal article
Publication Details: Proceedings of the ACM on human-computer interaction, Vol.7(MHCI), pp.1-27
Publisher: ACM
DOI: 10.1145/3604256
ISSN: 2573-0142
eISSN: 2573-0142
Grant note: IS-1850389 / National Science Foundation (http://dx.doi.org/10.13039/100000001)
Language: English
Date published: 09/12/2023
Academic Unit: Computer Science
Record Identifier: 9984696718002771

Metrics

1 Record Views