Journal article
Discovering and reconciling value conflicts for numerical data integration
Information systems (Oxford), Vol.26(8), pp.635-656
12/01/2001
DOI: 10.1016/S0306-4379(01)00043-6
Abstract
The built-up in Information Technology capital fueled by the Internet and cost-effectiveness of new telecommunications technologies has led to a proliferation of information systems that are in dire need to exchange information but incapable of doing so due to the lack of
semantic interoperability. It is now evident that physical connectivity (the ability to exchange bits and bytes) is no longer adequate: the integration of data from autonomous and heterogeneous systems calls for the prior identification and resolution of semantic conflicts that may be present. Unfortunately, this requires the system integrator to sift through the data from disparate systems in a painstaking manner. We suggest that this process can be partially automated by presenting a methodology and technique for the discovery of potential semantic conflicts as well as the underlying data transformation needed to resolve the conflicts. Our methodology begins by classifying data value conflicts into two categories:
context independent and
context dependent. While context independent conflicts are usually caused by unexpected errors, the context dependent conflicts are primarily a result of the heterogeneity of underlying data sources. To facilitate data integration, data value conversion rules are proposed to describe the quantitative relationships among data values involving context dependent conflicts. A general approach is proposed to discover data value conversion rules from the data. The approach consists of the five major steps: relevant attribute analysis, candidate model selection, conversion function generation, conversion function selection and conversion rule formation. It is being implemented in a prototype system, DIRECT, for business data using statistics based techniques. Preliminary study using both synthetic and real world data indicated that the proposed approach is promising.
Details
- Title: Subtitle
- Discovering and reconciling value conflicts for numerical data integration
- Creators
- Weiguo Fan - University of Michigan–Ann ArborHongjun Lu - Hong Kong University of Science and TechnologyStuart E. Madnick - Sloan School of Management, MIT USADavid Cheung - Department of Computer Science, Hong Kong University, Hong Kong, China
- Resource Type
- Journal article
- Publication Details
- Information systems (Oxford), Vol.26(8), pp.635-656
- Publisher
- Elsevier Ltd
- DOI
- 10.1016/S0306-4379(01)00043-6
- ISSN
- 0306-4379
- eISSN
- 1873-6076
- Language
- English
- Date published
- 12/01/2001
- Academic Unit
- Business Analytics
- Record Identifier
- 9984380394302771
Metrics
1 Record Views