Logo image
Simple Parallel Statistical Computing in R
Journal article   Open access   Peer reviewed

Simple Parallel Statistical Computing in R

A. J Rossini, Luke Tierney and Na Li
Journal of computational and graphical statistics, Vol.16(2), pp.399-420
06/01/2007
DOI: 10.1198/106186007X178979
url
https://doi.org/10.1198/106186007X178979View
Published (Version of record) Open Access

Abstract

Theoretically, many modern statistical procedures are trivial to parallelize. However, practical deployment of a parallelized implementation which is robust and reliably runs on different computational cluster configurations and environments is far from trivial. We present a framework for the R statistical computing language that provides a simple yet powerful programming interface to a computational cluster of CPUs. This interface allows the rapid development of R functions that distribute independent computations across the nodes of the computational cluster. The approach can be extended to finer grain parallelization if needed. The resulting framework allows statisticians to obtain significant speed-ups for some computations at little additional development cost. The particular implementation can be deployed in ad-hoc heterogeneous computing environments.
Bootstrap Cross-validation Grid computing Kriging LAM-MPI Message passing MPI Profile likelihood pVM

Details

Metrics

Logo image