Stanford InfoLab Publication Server

Joint Entity Resolution on Multiple Datasets

Whang, Steven Euijong and Garcia-Molina, Hector (2013) Joint Entity Resolution on Multiple Datasets. The VLDB Journal .


[img]PDF - Accepted Version


Entity resolution (ER) is the problem of identifying which records in a database represent the same entity. Often, records of different types are involved (e.g., authors, publications, institutions, venues), and resolving records of one type can impact the resolution of other types of records. In this paper we propose a flexible, modular resolution framework where existing ER algorithms developed for a given record type can be plugged in and used in concert with other ER algorithms. Our approach also makes it possible to run ER on subsets of similar records at a time, important when the full data is too large to resolve together. We study the scheduling and coordination of the individual ER algorithms, in order to resolve the full data set, and show the scalability of our approach. We also introduce a ``state-based'' training technique where each ER algorithm is trained for the particular execution context (relative to other types of records) where it will be used.

Item Type:Article
ID Code:1066
Deposited By:Steven Whang
Deposited On:01 Feb 2013 23:12
Last Modified:01 Feb 2013 23:13

Download statistics

Repository Staff Only: item control page