Haveliwala, Taher and Gionis, Aristides and Klein, Dan and Indyk, Piotr (2001) Similarity Search on the Web: Evaluation and Scalability Considerations. Technical Report. Stanford.
Allowing users to find pages on the web similar to a particular query page is a crucial component of modern search engines. A variety of techniques and approaches exist to support "Related Pages" queries. In this paper we discuss shortcomings of previous approaches and present a unifying approach that puts special emphasis on the use of text, both within anchors and surrounding anchors. In the central contribution of our paper, we present a novel technique for automating the evaluation process, allowing us to tune our parameters to maximize the quality of the results. Finally, we show how to scale our approach to millions of web pages, using the established Locality-Sensitive-Hashing technique.
|Item Type:||Techreport (Technical Report)|
|Uncontrolled Keywords:||web search, related pages, similarity search, clustering|
|Subjects:||Computer Science > Data Mining|
Computer Science > Digital Libraries
|Related URLs:||Project Homepage, Project Homepage||http://infolab.stanford.edu/, http://www-nlp.stanford.edu/|
|Deposited By:||Import Account|
|Deposited On:||25 Feb 2001 16:00|
|Last Modified:||27 Dec 2008 09:57|
Available Versions of this Item
- Similarity Search on the Web: Evaluation and Scalability Considerations. (deposited 25 Feb 2001 16:00) [Currently Displayed]
Repository Staff Only: item control page