Stanford InfoLab Publication Server

Multicasting a Web Repository

Lam, Wang and Garcia-Molina, Hector (2001) Multicasting a Web Repository. In: Fourth International Workshop on the Web and Databases (WebDB 2001), May 24-25, 2001, Santa Barbara, California.




Web crawlers generate significant loads on Web servers, and are difficult to operate. Instead of running crawlers at many "client" sites, we propose a central crawler and Web repository that then multicasts appropriate subsets of the central repository to clients. Loads at Web servers are reduced because a single crawler visits the servers, as opposed to all the client crawlers. In this paper we model and evaluate such a central Web multicast facility. We develop multicast algorithms for the facility, comparing them with ones for "broadcast disks." We also evaluate performance as several factors, such as object granularity and client batching, are varied.

Item Type:Conference or Workshop Item (Paper)
Uncontrolled Keywords:Web multicast facility
Subjects:Computer Science > Databases and the Web
Projects:Digital Libraries
Related URLs:Project Homepage
ID Code:499
Deposited By:Import Account
Deposited On:18 Jul 2001 17:00
Last Modified:27 Dec 2008 10:22

Download statistics

Repository Staff Only: item control page