Journal article
Scalable Bayes via Barycenter in Wasserstein Space
Journal of machine learning research, Vol.19, pp.1-35
01/01/2018
Abstract
Divide-and-conquer based methods for Bayesian inference provide a general approach for tractable posterior inference when the sample size is large. These methods divide the data into smaller subsets, sample from the posterior distribution of parameters in parallel on all the subsets, and combine posterior samples from all the subsets to approximate the full data posterior distribution. The smaller size of any subset compared to the full data implies that posterior sampling on any subset is computationally more efficient than sampling from the true posterior distribution. Since the combination step takes negligible time relative to sampling, posterior computations can be scaled to massive data by dividing the full data into sufficiently large number of data subsets. One such approach relies on the geometry of posterior distributions estimated across different subsets and combines them through their barycenter in a Wasserstein space of probability measures. We provide theoretical guarantees on the accuracy of approximation that are valid in many applications. We show that the geometric method approximates the full data posterior distribution better than its competitors across diverse simulations and reproduces known results when applied to a movie ratings database.
Details
- Title: Subtitle
- Scalable Bayes via Barycenter in Wasserstein Space
- Creators
- Sanvesh Srivastava - Univ Iowa, Dept Stat & Actuarial Sci, Iowa City, IA 52242 USACheng Li - Natl Univ Singapore, Dept Stat & Appl Probabil, Singapore 117546, SingaporeDavid B Dunson - Duke University
- Resource Type
- Journal article
- Publication Details
- Journal of machine learning research, Vol.19, pp.1-35
- Publisher
- MICROTOME PUBL
- ISSN
- 1532-4435
- eISSN
- 1533-7928
- Number of pages
- 35
- Grant note
- R155000172133 / National University of Singapore
- Language
- English
- Date published
- 01/01/2018
- Academic Unit
- Statistics and Actuarial Science
- Record Identifier
- 9984257625202771
Metrics
19 Record Views