Stanford InfoLab Publication Server

Question Selection for Crowd Entity Resolution

Whang, Steven Euijong and Lofgren, Peter and Garcia-Molina, Hector Question Selection for Crowd Entity Resolution. Technical Report. Stanford InfoLab.


PDF - Draft Version


We study the problem of enhancing Entity Resolution (ER) with the help of crowdsourcing. ER is the problem of clustering records that refer to the same real-world entity and can be an extremely difficult process for computer algorithms alone. For example, figuring out which images refer to the same person can be a hard task for computers, but an easy one for humans. We study the problem of resolving records with crowdsourcing where we ask questions to humans in order to guide ER into producing accurate results. Since human work is costly, our goal is to ask as few questions as possible. We propose a probabilistic framework for ER that can be used to estimate how much ER accuracy we obtain by asking each question and select the best question with the highest expected accuracy. Computing the expected accuracy is \NP-hard, so we propose approximation techniques for efficient computation. We evaluate our best question algorithms on real and synthetic datasets and demonstrate how we can obtain high ER accuracy while significantly reducing the number of questions asked to humans.

Item Type:Techreport (Technical Report)
ID Code:1047
Deposited By:Steven Whang
Deposited On:08 Jul 2012 17:02
Last Modified:10 Jul 2012 09:29

Download statistics

Repository Staff Only: item control page