Stanford InfoLab Publication Server

Adaptive Filters for Continuous Queries over Distributed Data Streams

Olston, Chris and Jiang, Jing and Widom, Jennifer (2003) Adaptive Filters for Continuous Queries over Distributed Data Streams. In: ACM International Conference on Management of Data (SIGMOD 2003), June 9-12, 2003, San Diego, California .

BibTeXDublinCoreEndNoteHTML

This is the latest version of this item.

[img]
Preview
PDF
226Kb

Abstract

We consider an environment where distributed data sources continuously stream updates to a centralized processor that monitors continuous queries over the distributed data. Significant communication overhead is incurred in the presence of rapid update streams, and we propose a new technique for reducing the overhead. Users register continuous queries with precision requirements at the central stream processor, which installs filters at remote data sources. The filters adapt to changing conditions to minimize stream rates while guaranteeing that all continuous queries still receive the updates necessary to provide answers of adequate precision at all times. Our approach enables applications to trade precision for communication overhead at a fine granularity by individually adjusting the precision constraints of continuous queries over streams in a multi-query workload. Through experiments performed on synthetic data simulations and a real network monitoring implementation, we demonstrate the effectiveness of our approach in achieving low communication overhead compared with alternate approaches.

Item Type:Conference or Workshop Item (Paper)
Subjects:Computer Science > Data Streams
Computer Science > Distributed Systems
Projects:STREAM
TRAPP
Related URLs:Project Homepage, Project Homepagehttp://infolab.stanford.edu/stream/, http://infolab.stanford.edu/trapp/
ID Code:864
Deposited By:Import Account
Deposited On:12 Feb 2003 16:00
Last Modified:24 Dec 2008 10:49

Available Versions of this Item

Download statistics

Repository Staff Only: item control page