A Divide-and-Conquer Bayesian Approach to Large-Scale Kriging

Rajarshi Guhaniyogi; Cheng Li; Terrance D Savitsky; Sanvesh Srivastava

doi:10.48550/arXiv.1712.09767

Back

A Divide-and-Conquer Bayesian Approach to Large-Scale Kriging

Preprint

Open access

A Divide-and-Conquer Bayesian Approach to Large-Scale Kriging

Rajarshi Guhaniyogi, Cheng Li, Terrance D Savitsky and Sanvesh Srivastava

ArXiv.org

Cornell University

12/28/2017

DOI: 10.48550/arXiv.1712.09767

Files and links (1)

url

https://doi.org/10.48550/arXiv.1712.09767View

Preprint (Author's original)This preprint has not been evaluated by subject experts through peer review. Preprints may undergo extensive changes and/or become peer-reviewed journal articles. Open Access

Abstract

We propose a three-step divide-and-conquer strategy within the Bayesian paradigm that delivers massive scalability for any spatial process model. We partition the data into a large number of subsets, apply a readily available Bayesian spatial process model on every subset, in parallel, and optimally combine the posterior distributions estimated across all the subsets into a pseudo-posterior distribution that conditions on the entire data. The combined pseudo posterior distribution replaces the full data posterior distribution for predicting the responses at arbitrary locations and for inference on the model parameters and spatial surface. Based on distributed Bayesian inference, our approach is called "Distributed Kriging" (DISK) and offers significant advantages in massive data applications where the full data are stored across multiple machines. We show theoretically that the Bayes $L_2$-risk of the DISK posterior distribution achieves the near optimal convergence rate in estimating the true spatial surface with various types of covariance functions, and provide upper bounds for the number of subsets as a function of the full sample size. The model-free feature of DISK is demonstrated by scaling posterior computations in spatial process models with a stationary full-rank and a nonstationary low-rank Gaussian process (GP) prior. A variety of simulations and a geostatistical analysis of the Pacific Ocean sea surface temperature data validate our theoretical results.

Statistics - Methodology

Details

Title: Subtitle: A Divide-and-Conquer Bayesian Approach to Large-Scale Kriging
Creators: Rajarshi Guhaniyogi
Cheng Li
Terrance D Savitsky
Sanvesh Srivastava
Resource Type: Preprint
Publication Details: ArXiv.org
DOI: 10.48550/arXiv.1712.09767
ISSN: 2331-8422
Publisher: Cornell University
Language: English
Date posted: 12/28/2017
Academic Unit: Statistics and Actuarial Science
Record Identifier: 9984288738102771

Metrics

166 Record Views