Journal article
Improved generalization via tolerant training
Journal of optimization theory and applications, Vol.96(2), pp.259-279
02/01/1998
DOI: 10.1023/A:1022664513146
Abstract
Theoretical and computational justification is given for improved generalization when the training set is learned with less accuracy. The model used for this investigation is a simple linear one. It is shown that learning a training set with a tolerance τ improves generalization, over zero-tolerance training, for any testing set satisfying a certain closeness condition to the training set. These results, obtained via a mathematical programming formulation, are placed in the context of some well-known machine learning results. Computational confirmation of improved generalization is given for linear systems (including nine of the twelve real-world data sets tested), as well as for nonlinear systems such as neural networks for which no theoretical results are available at present. In particular, the tolerant training method improves generalization on noisy, sparse, and overparameterized problems.
Details
- Title: Subtitle
- Improved generalization via tolerant training
- Creators
- W. N Street - Oklahoma State UniversityO. L Mangasarian - University of Wisconsin–Madison
- Resource Type
- Journal article
- Publication Details
- Journal of optimization theory and applications, Vol.96(2), pp.259-279
- Publisher
- Springer
- DOI
- 10.1023/A:1022664513146
- ISSN
- 0022-3239
- eISSN
- 1573-2878
- Language
- English
- Date published
- 02/01/1998
- Academic Unit
- Nursing; Business Analytics; Computer Science; Bus Admin College
- Record Identifier
- 9984380412102771
Metrics
1 Record Views