Data Lineage: A Survey

Abstract

Lineage, or provenance, in its most general form describes where data came from, how it was derived, and how it was updated over time. Information management systems today exploit lineage in tasks ranging from data verification in curated databases to confidence computation in probabilistic databases. Here, we formalize and categorize lineage, discuss a set of selected papers, and then identify open problems in lineage research.