Conference proceeding
Robust Ensemble Clustering by Matrix Completion
2012 IEEE 12th International Conference on Data Mining, pp.1176-1181
12/2012
DOI: 10.1109/ICDM.2012.123
Abstract
Data clustering is an important task and has found applications in numerous real-world problems. Since no single clustering algorithm is able to identify all different types of cluster shapes and structures, ensemble clustering was proposed to combine different partitions of the same data generated by multiple clustering algorithms. The key idea of most ensemble clustering algorithms is to find a partition that is consistent with most of the available partitions of the input data. One problem with these algorithms is their inability to handle uncertain data pairs, i.e. data pairs for which about half of the partitions put them into the same cluster and the other half do the opposite. When the number of uncertain data pairs is large, they can mislead the ensemble clustering algorithm in generating the final partition. To overcome this limitation, we propose an ensemble clustering approach based on the technique of matrix completion. The proposed algorithm constructs a partially observed similarity matrix based on the data pairs whose cluster memberships are agreed upon by most of the clustering algorithms in the ensemble. It then deploys the matrix completion algorithm to complete the similarity matrix. The final data partition is computed by applying an efficient spectral clustering algorithm to the completed matrix. Our empirical studies with multiple real-world datasets show that the proposed algorithm performs significantly better than the state-of-the-art algorithms for ensemble clustering.
Details
- Title: Subtitle
- Robust Ensemble Clustering by Matrix Completion
- Creators
- Jinfeng Yi - Michigan State UniversityTianbao Yang - General ElectricRong Jin - Michigan State UniversityA. K Jain - Michigan State UniversityM Mahdavi - Michigan State University
- Resource Type
- Conference proceeding
- Publication Details
- 2012 IEEE 12th International Conference on Data Mining, pp.1176-1181
- Publisher
- IEEE
- DOI
- 10.1109/ICDM.2012.123
- ISSN
- 1550-4786
- eISSN
- 2374-8486
- Language
- English
- Date published
- 12/2012
- Academic Unit
- Computer Science
- Record Identifier
- 9984259405402771
Metrics
9 Record Views