Logo image
Back
QuanDA: Quantile-Based Discriminant Analysis for High-Dimensional Imbalanced Classification
Conference proceeding   Open access

QuanDA: Quantile-Based Discriminant Analysis for High-Dimensional Imbalanced Classification

Qian Tang, Yuwen Gu and Boxiang Wang
Advances in neural information processing systems, Vol.38, pp.159735-159768
12/01/2025
PMID: 42405201
url
https://papers.nips.cc/paper_files/paper/2025/hash/ea34f9c3acb3de6fa29582ff469bcd6b-Abstract-Conference.htmlView
Published (Version of record) Open Access

Abstract

Binary classification with imbalanced classes is a common and fundamental task, where standard machine learning methods often struggle to provide reliable predictive performance. Although numerous approaches have been proposed to address this issue, classification in low-sample-size and high-dimensional settings still remains particularly challenging. The abundance of noisy features in high-dimensional data limits the effectiveness of classical methods due to overfitting, and the minority class is even difficult to detect because of its severe underrepresentation with low sample size. To address this challenge, we introduce Quantile-based Discriminant Analysis (QuanDA), which builds upon a novel connection with quantile regression and naturally accounts for class imbalance through appropriately chosen quantile levels. We provide comprehensive theoretical analysis to validate QuanDA in ultra-high dimensional settings. Through extensive simulation studies and high-dimensional benchmark data analysis, we demonstrate that QuanDA overall outperforms existing classification methods for imbalanced data, including cost-sensitive large-margin classifiers, random forests, and SMOTE.

Details

Metrics

1 Record Views
Logo image