Lam, Wang and Garcia-Molina, Hector (2003) Multicasting a Changing Repository. In: 19th International Conference on Data Engineering (ICDE 2003), March 5-8, 2003, Bangalore, India.
| BibTeX | DublinCore | EndNote | HTML |
This is the latest version of this item.
![[img]](/style/images/fileicons/application_pdf.png)
| PDF 719Kb |
Abstract
Web crawlers generate significant loads on Web servers, and are difficult to operate. Instead of repeatedly running crawlers at many "client" sites, we propose a central crawler and Web repository that multicasts appropriate subsets of the central repository, and their subsequent changes, to subscribing clients. Loads at Web servers are reduced because a single crawler visits the servers, as opposed to all the client crawlers. In this paper we model and evaluate such a central Web multicast facility for subscriber clients, and for mixes of subscriber and one-time downloader clients. We consider different performance metrics and multicast algorithms for such a multicast facility, and develop guidelines for its design under various conditions.
| Item Type: | Conference or Workshop Item (Paper) | |
|---|---|---|
| Uncontrolled Keywords: | Web repository WebBase multicast facility scheduling | |
| Subjects: | Computer Science > Databases and the Web Miscellaneous | |
| Projects: | Digital Libraries | |
| Related URLs: | Project Homepage | http://www-diglib.stanford.edu/diglib/pub/ |
| ID Code: | 751 | |
| Deposited By: | Import Account | |
| Deposited On: | 31 Jul 2003 17:00 | |
| Last Modified: | 24 Dec 2008 10:24 |
Available Versions of this Item
- Multicasting a Changing Repository. (deposited 26 Jun 2002 17:00)
- Multicasting a Changing Repository. (deposited 31 Jul 2003 17:00) [Currently Displayed]
Download statistics
Repository Staff Only: item control page
