Journal article
Null space conditions and thresholds for rank minimization
Mathematical programming, Vol.127(1), pp.175-202
10/12/2010
DOI: 10.1007/s10107-010-0422-2
Abstract
Minimizing the rank of a matrix subject to constraints is a challenging problem that arises in many applications in machine learning, control theory, and discrete geometry. This class of optimization problems, known as rank minimization, is NP-hard, and for most practical problems there are no efficient algorithms that yield exact solutions. A popular heuristic replaces the rank function with the nuclear norm—equal to the sum of the singular values—of the decision variable and has been shown to provide the optimal low rank solution in a variety of scenarios. In this paper, we assess the practical performance of this heuristic for finding the minimum rank matrix subject to linear equality constraints. We characterize properties of the null space of the linear operator defining the constraint set that are necessary and sufficient for the heuristic to succeed. We then analyze linear constraints sampled uniformly at random, and obtain dimension-free bounds under which our null space properties hold almost surely as the matrix dimensions tend to infinity. Finally, we provide empirical evidence that these probabilistic bounds provide accurate predictions of the heuristic’s performance in non-asymptotic scenarios.
Details
- Title: Subtitle
- Null space conditions and thresholds for rank minimization
- Creators
- Benjamin Recht - University of Wisconsin–MadisonWeiyu Xu - California Institute of TechnologyBabak Hassibi - California Institute of Technology
- Resource Type
- Journal article
- Publication Details
- Mathematical programming, Vol.127(1), pp.175-202
- Publisher
- Springer-Verlag
- DOI
- 10.1007/s10107-010-0422-2
- ISSN
- 0025-5610
- eISSN
- 1436-4646
- Language
- English
- Date published
- 10/12/2010
- Academic Unit
- Electrical and Computer Engineering
- Record Identifier
- 9984197171902771
Metrics
10 Record Views