Journal article
A Multicategory Kernel Distance Weighted Discrimination Method for Multiclass Classification
Technometrics, Vol.61(3), pp.396-408
07/03/2019
DOI: 10.1080/00401706.2018.1529629
Abstract
Distance weighted discrimination (DWD) is an interesting large margin classifier that has been shown to enjoy nice properties and empirical successes. The original DWD only handles binary classification with a linear classification boundary. Multiclass classification problems naturally appear in various fields, such as speech recognition, satellite imagery classification, and self-driving vehicles, to name a few. For such complex classification problems, it is desirable to have a flexible multicategory kernel extension of the binary DWD when the optimal decision boundary is highly nonlinear. To this end, we propose a new multicategory kernel DWD, that is, defined as a margin-vector optimization problem in a reproducing kernel Hilbert space. This formulation is shown to enjoy Fisher consistency. We develop an accelerated projected gradient descent algorithm to fit the multicategory kernel DWD. Simulations and benchmark data applications are used to demonstrate the highly competitive performance of our method, as compared with some popular state-of-the-art multiclass classifiers.
Details
- Title: Subtitle
- A Multicategory Kernel Distance Weighted Discrimination Method for Multiclass Classification
- Creators
- Boxiang Wang - Department of Statistics and Actuarial Science, University of IowaHui Zou - School of Statistics, University of Minnesota
- Resource Type
- Journal article
- Publication Details
- Technometrics, Vol.61(3), pp.396-408
- Publisher
- Taylor & Francis
- DOI
- 10.1080/00401706.2018.1529629
- ISSN
- 0040-1706
- eISSN
- 1537-2723
- Grant note
- DMS-1505111 / National Science Foundation
- Language
- English
- Date published
- 07/03/2019
- Academic Unit
- Statistics and Actuarial Science
- Record Identifier
- 9983985921702771
Metrics
25 Record Views