Journal article
Variable selection based on squared derivative averages
Automatica (Oxford), Vol.127, p.109491
05/2021
DOI: 10.1016/j.automatica.2021.109491
Abstract
Identification of a nonlinear nonparametric system is not easy. On the other hand, many systems are sparse in the sense that some variables do not contribute and some contribute only marginally. If these variables that do not contribute or contribute marginally can be detected and removed, the identification problem becomes lower dimensional and is relatively easy to deal with. The first goal of the paper is to develop an overlap group Lasso method to detect which variables contribute and which variables do not. The algorithm developed favors sparsity in terms of partial derivatives and provides a necessary and sufficient condition for a variable to contribute. Once contributing variables are identified, the second goal of the paper is to rank the importance of these variables based on the squared derivative averages. Since both the function and its derivatives are unknown, how to estimate the squared derivative averages is a concern. To this end, two methods are proposed with convergence results. The first one is nonparametric based on the Fourier transform of some intermediate variables. The other is to cast the problem in a Reproducing Kernel Hilbert Space (RKHS).
Details
- Title: Subtitle
- Variable selection based on squared derivative averages
- Creators
- Changming Cheng - University of IowaErwei Bai - University of Iowa
- Resource Type
- Journal article
- Publication Details
- Automatica (Oxford), Vol.127, p.109491
- Publisher
- Elsevier Ltd
- DOI
- 10.1016/j.automatica.2021.109491
- ISSN
- 0005-1098
- eISSN
- 1873-2836
- Grant note
- R15AG061755 / National Institute of Health, United States CNS-1239509 / National Science Foundation, United States 20PJ1409000 / Shanghai Pujiang Program, China R42CA195819 / National Institute of Health, United States 20ZR1425200 / Natural Science Foundation of Shanghai, China (http://dx.doi.org/10.13039/100007219) 11702171; 12072188 / National Natural Science Foundation of China (http://dx.doi.org/10.13039/501100001809)
- Language
- English
- Date published
- 05/2021
- Academic Unit
- Electrical and Computer Engineering
- Record Identifier
- 9984197275402771
Metrics
15 Record Views