Journal article
Selecting the Right Correlation Measure for Binary Data
ACM transactions on knowledge discovery from data, Vol.9(2), pp.1-28
11/17/2014
DOI: 10.1145/2637484
Abstract
Finding the most interesting correlations among items is essential for problems in many commercial, medical, and scientific domains. Although there are numerous measures available for evaluating correlations, different correlation measures provide drastically different results. Piatetsky-Shapiro provided three mandatory properties for any reasonable correlation measure, and Tan et al. proposed several properties to categorize correlation measures; however, it is still hard for users to choose the desirable correlation measures according to their needs. In order to solve this problem, we explore the effectiveness problem in three ways. First, we propose two desirable properties and two optional properties for correlation measure selection and study the property satisfaction for different correlation measures. Second, we study different techniques to adjust correlation measures and propose two new correlation measures: the Simplified χ 2 with Continuity Correction and the Simplified χ 2 with Support. Third, we analyze the upper and lower bounds of different measures and categorize them by the bound differences. Combining these three directions, we provide guidelines for users to choose the proper measure according to their needs.
Details
- Title: Subtitle
- Selecting the Right Correlation Measure for Binary Data
- Creators
- Lian Duan - New Jersey Institute of TechnologyW. Nick Street - University of IowaYanchi Liu - New Jersey Institute of TechnologySonghua Xu - New Jersey Institute of TechnologyBrook Wu - New Jersey Institute of Technology
- Resource Type
- Journal article
- Publication Details
- ACM transactions on knowledge discovery from data, Vol.9(2), pp.1-28
- DOI
- 10.1145/2637484
- ISSN
- 1556-4681
- eISSN
- 1556-472X
- Language
- English
- Date published
- 11/17/2014
- Academic Unit
- Bus Admin College; Nursing; Computer Science; Business Analytics
- Record Identifier
- 9984380479002771
Metrics
4 Record Views