Title
Applying semantic similarity measures to enhance topic-specific web crawling
Abstract
As the Internet grows rapidly, finding desirable information becomes a tedious and time consuming task. Topic-specific web crawlers, as utopian solutions, tackle this issue through traversing the Web and collecting information related to the topic of interest. In this regard, various methods are proposed. Nevertheless, they hardly consider desired sense of the given topic which would certainly play an important role to find relevant web pages. In this paper, we attempt to improve topic-specific web crawling by disambiguating the sense of the topic. This would avoid crawling irrelevant links interlaced with other senses of the topic. For this purpose, by considering links hypertext semantic, we employ Lin semantic similarity measure in our crawler, named LinCrawler, to distinguish topic sense-related links from the others. Moreover, we compare LinCrawler against TFCrawler which only considers frequency of terms in hypertexts. Experimental results show LinCrawler outperforms TFCrawler to collect more relevant web pages.
Year
DOI
Venue
2013
10.1109/ISDA.2013.6920736
Intelligent Systems Design and Applications
Keywords
DocType
ISBN
Web sites,data mining,hypermedia,information retrieval,semantic Web,Internet,Lin semantic similarity measure,LinCrawler,TFCrawler,Web data mining,Web pages,information collection,information retrieval,links hypertext semantic,semantic Web,topic sense disambiguation,topic sense-related links,topic-specific Web crawling,utopian solutions,Information Retrieval,Link Prediction,Semantic Web,Topic-Specific Web Crawling,Web Data Mining
Conference
978-1-4799-3515-4
Citations 
PageRank 
References 
0
0.34
0
Authors
3
Name
Order
Citations
PageRank
Pesaranghader, A.100.34
Norwati Mustapha212026.61
Ahmad Pesaranghader3284.20