Journal article
Bayesian Variable Selection Under Collinearity
The American Statistician, Vol.69(3), pp.165-173
07/03/2015
DOI: 10.1080/00031305.2015.1031827
Abstract
In this article, we highlight some interesting facts about Bayesian variable selection methods for linear regression models in settings where the design matrix exhibits strong collinearity. We first demonstrate via real data analysis and simulation studies that summaries of the posterior distribution based on marginal and joint distributions may give conflicting results for assessing the importance of strongly correlated covariates. The natural question is which one should be used in practice. The simulation studies suggest that posterior inclusion probabilities and Bayes factors that evaluate the importance of correlated covariates jointly are more appropriate, and some priors may be more adversely affected in such a setting. To obtain a better understanding behind the phenomenon, we study some toy examples with Zellner's g-prior. The results show that strong collinearity may lead to a multimodal posterior distribution over models, in which joint summaries are more appropriate than marginal summaries. Thus, we recommend a routine examination of the correlation matrix and calculation of the joint inclusion probabilities for correlated covariates, in addition to marginal inclusion probabilities, for assessing the importance of covariates in Bayesian variable selection.
Details
- Title: Subtitle
- Bayesian Variable Selection Under Collinearity
- Creators
- Joyee GhoshAndrew E Ghattas
- Resource Type
- Journal article
- Publication Details
- The American Statistician, Vol.69(3), pp.165-173
- Publisher
- Taylor & Francis
- DOI
- 10.1080/00031305.2015.1031827
- ISSN
- 0003-1305
- eISSN
- 1537-2731
- Language
- English
- Date published
- 07/03/2015
- Academic Unit
- Biostatistics; Statistics and Actuarial Science
- Record Identifier
- 9983985971302771
Metrics
23 Record Views