Journal article
Sparse Convoluted Rank Regression in High Dimensions
Journal of the American Statistical Association, Vol.119(546), pp.1500-1512
06/2024
DOI: 10.1080/01621459.2023.2202433
Abstract
Wang et al. studied the high-dimensional sparse penalized rank regression and established its nice theoretical properties. Compared with the least squares, rank regression can have a substantial gain in estimation efficiency while maintaining a minimal relative efficiency of (Formula presented.). However, the computation of penalized rank regression can be very challenging for high-dimensional data, due to the highly nonsmooth rank regression loss. In this work we view the rank regression loss as a nonsmooth empirical counterpart of a population level quantity, and a smooth empirical counterpart is derived by substituting a kernel density estimator for the true distribution in the expectation calculation. This view leads to the convoluted rank regression loss and consequently the sparse penalized convoluted rank regression (CRR) for high-dimensional data. We prove some interesting asymptotic properties of CRR. Under the same key assumptions for sparse rank regression, we establish the rate of convergence of the (Formula presented.) -penalized CRR for a tuning free penalization parameter and prove the strong oracle property of the folded concave penalized CRR. We further propose a high-dimensional Bayesian information criterion for selecting the penalization parameter in folded concave penalized CRR and prove its selection consistency. We derive an efficient algorithm for solving sparse convoluted rank regression that scales well with high dimensions. Numerical examples demonstrate the promising performance of the sparse convoluted rank regression over the sparse rank regression. Our theoretical and numerical results suggest that sparse convoluted rank regression enjoys the best of both sparse least squares regression and sparse rank regression. Supplementary materials for this article are available online.
Details
- Title: Subtitle
- Sparse Convoluted Rank Regression in High Dimensions
- Creators
- Le Zhou - Hong Kong Baptist UniversityBoxiang Wang - University of IowaHui Zou - University of Minnesota
- Resource Type
- Journal article
- Publication Details
- Journal of the American Statistical Association, Vol.119(546), pp.1500-1512
- DOI
- 10.1080/01621459.2023.2202433
- ISSN
- 0162-1459
- eISSN
- 1537-274X
- Grant note
- DOI: 10.13039/501100000930, name: NSF, award: 1915842, 2015120
- Language
- English
- Electronic publication date
- 04/12/2023
- Date published
- 06/2024
- Academic Unit
- Statistics and Actuarial Science
- Record Identifier
- 9984410785802771
Metrics
117 Record Views