Stanford InfoLab Publication Server

Question Selection for Crowd Entity Resolution

Whang, Steven Euijong and Lofgren, Peter and Garcia-Molina, Hector (2013) Question Selection for Crowd Entity Resolution. In: PVLDB, August 26-30, 2013, Trento, Italy.

BibTeXDublinCoreEndNoteHTML

[img]
Preview
PDF - Accepted Version
1626Kb

Abstract

We study the problem of enhancing Entity Resolution (ER) with the help of crowdsourcing. ER is the problem of clustering records that refer to the same real-world entity and can be an extremely difficult process for computer algorithms alone. For example, figuring out which images refer to the same person can be a hard task for computers, but an easy one for humans. We study the problem of resolving records with crowdsourcing where we ask questions to humans in order to guide ER into producing accurate results. Since human work is costly, our goal is to ask as few questions as possible. We propose a probabilistic framework for ER that can be used to estimate how much ER accuracy we obtain by asking each question and select the best question with the highest expected accuracy. Computing the expected accuracy is \#\P-hard, so we propose approximation techniques for efficient computation. We evaluate our best question algorithms on real and synthetic datasets and demonstrate how we can obtain high ER accuracy while significantly reducing the number of questions asked to humans.

Item Type:Conference or Workshop Item (Paper)
Projects:SERF
ID Code:1064
Deposited By:Steven Whang
Deposited On:01 Feb 2013 01:15
Last Modified:01 Feb 2013 01:15

Download statistics

Repository Staff Only: item control page