Logo image
Moment bounds for condition numbers and singular values of high-dimensional Gaussian random matrices: Applications and limitations
Preprint   Open access

Moment bounds for condition numbers and singular values of high-dimensional Gaussian random matrices: Applications and limitations

Partha Sarkar, Kshitij Khare and Sanvesh Srivastava
ArXiv.org
Cornell University
02/25/2026
DOI: 10.48550/arxiv.2602.21487
url
https://doi.org/10.48550/arxiv.2602.21487View
Preprint (Author's original)This preprint has not been evaluated by subject experts through peer review. Preprints may undergo extensive changes and/or become peer-reviewed journal articles. Open Access

Abstract

Spectral properties of Gram matrices are central to high dimensional asymptotic analyses of statistical estimators in regression and covariance estimation. These properties, in turn, depend critically on the extreme singular values and condition numbers of Gaussian random matrices. For many applications, sharp positive and negative moment bounds for these quantities are required to control expected prediction risk and related performance metrics. Although extensive work provides concentration and tail bounds for extreme singular values of Gaussian random matrices, these results do not readily yield the moment bounds needed in such analyses. Motivated by this gap, we establish non asymptotic moment bounds for arbitrary positive moments of the largest singular value and arbitrary negative moments of the smallest singular value, and uniform bounds for arbitrary positive moments of the condition number of high dimensional Gaussian random matrices. We demonstrate the utility of these bounds by applying them to derive explicit risk guarantees in high dimensional regression and covariance estimation, as well as to obtain bounds on the mean iteration complexity of gradient descent for solving Gram linear systems. Finally, we present counterexamples demonstrating that the positive condition number moment bounds and negative smallest singular value moment bounds cannot, in general, be extended to the broader class of sub Gaussian random matrices.
Mathematics - Statistics Theory Statistics - Theory

Details

Metrics

2 Record Views
Logo image