Stanford InfoLab Publication Server

Optimization of Continuous Queries with Shared Expensive Filters

Munagala, Kamesh and Srivastava, Utkarsh and Widom, Jennifer (2005) Optimization of Continuous Queries with Shared Expensive Filters. Technical Report. Stanford.




We consider the problem of optimizing and executing multiple continuous queries, where each query is a conjunction of filters and each filter may occur in multiple queries. When filters are expensive, significant performance gains are achieved by sharing filter evaluations across queries. A shared execution strategy in our scenario can either be fixed, in which filters are evaluated in the same predetermined order for all input, or {\em adaptive}, in which the next filter to be evaluated is chosen at runtime based on the results of the filters evaluated so far. We show that as filter costs increase, the best adaptive strategy is superior to any fixed strategy, despite the overhead of adaptivity. We show that it is NP-hard to find the optimal adaptive strategy, even if we are willing to approximate within any factor smaller than logarithmic in the number of queries. We present a greedy execution strategy and show that it approximates the best adaptive strategy to within a factor polylogarithmic in the number of queries and filters. We also show how the execution overhead of adaptive strategies can be reduced by appropriate precomputation. Finally, we present an experimental evaluation demonstrating the effectiveness of our techniques.

Item Type:Techreport (Technical Report)
Uncontrolled Keywords:continuous queries, streams, expensive filters, shared execution
Subjects:Computer Science > Data Streams
Related URLs:Project Homepage
ID Code:700
Deposited By:Import Account
Deposited On:29 Nov 2005 16:00
Last Modified:22 Dec 2008 18:22

Download statistics

Repository Staff Only: item control page