Journal article
Online Bayesian Variable Selection and Bayesian Model Averaging for Streaming Data
Stat (International Statistical Institute), Vol.14(1), e70044
03/2025
DOI: 10.1002/sta4.70044
Appears in UI Libraries Support Open Access
Abstract
There is an increasing prevalence of streaming data generation in diverse fields like healthcare, finance, social media, and weather forecasting. In order to acquire helpful insights from these massive datasets, timely analysis is essential. In this article, we assume that the streaming data are analysed in batches. Traditional offline methods, which involve storing and analysing all individual records, can be repeatedly applied to the cumulative data, but encounter significant challenges in storage and computing costs. Existing online methods offer faster approximations but most methods neglect model uncertainty, causing overconfidence and instability. To bridge this gap, we propose novel online Bayesian approaches that incorporate model uncertainty within a Bayesian model averaging (BMA) framework, for generalized linear models (GLMs). We propose computationally efficient methods to update the posterior, with individual records from the latest batch of data and summary statistics from previous batches. We demonstrate using simulation studies and real data that our methods can offer much faster analysis compared to traditional methods, with no substantial drop in accuracy.
Details
- Title: Subtitle
- Online Bayesian Variable Selection and Bayesian Model Averaging for Streaming Data
- Creators
- Joyee Ghosh - University of IowaAixin Tan - University of IowaLan Luo - Rutgers, The State University of New Jersey
- Resource Type
- Journal article
- Publication Details
- Stat (International Statistical Institute), Vol.14(1), e70044
- Publisher
- Wiley
- DOI
- 10.1002/sta4.70044
- ISSN
- 2049-1573
- eISSN
- 2049-1573
- Grant note
- National Institue on Aging: R21AG083364 National Institute on Aging of the National Institutes of Health
The authors thank the editor, the associate editor, two reviewers, and Drs. Kate Cowles and Amy Herring for constructive comments on this work. Luo was partly supported by the National Institute on Aging of the National Institutes of Health (R21AG083364).
- Language
- English
- Date published
- 03/2025
- Academic Unit
- Statistics and Actuarial Science
- Record Identifier
- 9984790974602771
Metrics
4 Record Views