Stanford InfoLab Publication Server

Bootstrapping Pay-As-You-Go Data Integration Systems

Das Sarma, Anish and Dong, Luna and Halevy, Alon (2008) Bootstrapping Pay-As-You-Go Data Integration Systems. In: ACM SIGMOD international conference on Management of data 2008 (SIGMOD 2008) , June 09 - 12, 2008, Vancouver, Canada.




Data integration systems offer a uniform interface to a set of data sources. Despite recent progress, setting up and maintaining a data integration application still requires significant upfront effort of creating a mediated schema and semantic mappings from the data sources to the mediated schema. Many application contexts involving multiple data sources (e.g., the web, personal information management, enterprise intranets) do not require full integration in order to provide useful services, motivating a pay-as-you-go approach to integration. With that approach, a system starts with very few (or inaccurate) semantic mappings and these mappings are improved over time as deemed necessary. This paper describes the first completely self-configuring data integration system. The goal of our work is to investigate how advanced of a starting point we can provide a pay-as-you-go system. Our system is based on the new concept of a probabilistic mediated schema that is automatically created from the data sources. We automatically create probabilistic schema mappings between the sources and the mediated schema. We describe experiments in multiple domains, including 50-800 data sources, and show that our system is able to produce high-quality answers with no human intervention.

Item Type:Conference or Workshop Item (Paper)
Uncontrolled Keywords:pay-as-you-go data integration
ID Code:851
Deposited By:Import Account
Deposited On:16 Mar 2008 17:00
Last Modified:10 Dec 2008 15:44

Download statistics

Repository Staff Only: item control page