Journal article
Open source head and face estimation as a complement to commercial eye-tracking
Journal of transportation safety & security, Vol.17(6), pp.700-714
06/03/2025
DOI: 10.1080/19439962.2024.2449117
Abstract
Eye-tracking solutions are a mainstay in driver modeling research; however, their limitations motivate exploration of complementary methods. One such is available in a class of machine vision models that estimate head pose, eye gaze, facial landmarks, and facial action units. In this article, we share lessons learned from using an open source tool to measure driver behavior. We selected a tool called OpenFace and applied it to an existing drowsy driving dataset that was collected with a commercial camera-based driver monitoring system. Forty participants each drove for around three hours in the early morning. Variables from the driver monitoring system combined with other simulator data and a set of videos from different cameras were recorded as part of the simulator video capture software. OpenFace was used to process the driver-facing video and integrate its output into the dataset. We considered a set of measures appropriate for modeling driver drowsiness, including eye closure, gaze dispersion, head movements, head stillness, and facial contortions (e.g., yawns, brow furrowing, etc.). We present comparisons of similar data between the commercial system and open-source model. Several lessons learned on topics including camera placement, ambient lighting, and data synchronization are shared, along with recommendations for future work.
Details
- Title: Subtitle
- Open source head and face estimation as a complement to commercial eye-tracking
- Creators
- Chris Schwarz - University of IowaJohn Gaspar - University of Iowa
- Resource Type
- Journal article
- Publication Details
- Journal of transportation safety & security, Vol.17(6), pp.700-714
- DOI
- 10.1080/19439962.2024.2449117
- ISSN
- 1943-9962
- eISSN
- 1943-9970
- Publisher
- Taylor & Francis
- Number of pages
- 15
- Language
- English
- Electronic publication date
- 01/20/2025
- Date published
- 06/03/2025
- Academic Unit
- Iowa Technology Institute; Driving Safety Research Institute
- Record Identifier
- 9984786309402771
Metrics
7 Record Views