Lam, Wang and Garcia-Molina, Hector (2002) Multicasting a Changing Repository [extended version]. Technical Report. Stanford.
| BibTeX | DublinCore | EndNote | HTML |
This is the latest version of this item.
![[img]](/style/images/fileicons/application_pdf.png)
| PDF 1092Kb |
Abstract
Web crawlers generate significant loads on Web servers, and are difficult to operate. Instead of repeatedly running crawlers at many "client" sites, we propose a central crawler and Web repository that multicasts appropriate subsets of the central repository, and their subsequent changes, to subscribing clients. Loads at Web servers are reduced because a single crawler visits the servers, as opposed to all the client crawlers. In this paper we model and evaluate such a central Web multicast facility for subscriber clients, and for mixes of subscriber and one-time downloader clients. We consider different performance metrics and multicast algorithms for such a multicast facility, and develop guidelines for its design under various conditions.
| Item Type: | Techreport (Technical Report) | |
|---|---|---|
| Uncontrolled Keywords: | Web repository WebBase multicast facility scheduling | |
| Subjects: | Computer Science > Databases and the Web Miscellaneous | |
| Projects: | Digital Libraries | |
| Related URLs: | Project Homepage | http://www-diglib.stanford.edu/diglib/pub/ |
| ID Code: | 741 | |
| Deposited By: | Import Account | |
| Deposited On: | 26 Jun 2002 17:00 | |
| Last Modified: | 25 Dec 2008 09:42 |
Available Versions of this Item
- Multicasting a Changing Repository. (deposited 11 Nov 2001 16:00)
- Multicasting a Changing Repository [extended version]. (deposited 26 Jun 2002 17:00) [Currently Displayed]
Download statistics
Repository Staff Only: item control page
