Paper Info
Title
Some (Non-)universal features of Web robot traffic
Abstract
Understanding the qualities of Web robot traffic is essential to build mechanisms for mitigating the impact of their traffic on Web systems. This paper presents an updated characterization of the navigational and session patterns of Web robot traffic across three Web servers in the United States, Europe, and the Middle East under 30 different features. The results indicate that some features may be fitted to the same heavy-tailed model across the Web servers, but the best fitting models for other features depend on the Web server. Due to some different tasks of Web robots and security policies set by website administrators, there are thus some features of Web robot traffic that cannot be universally modeled.
Year
DOI
Venue
2018
10.1109/CISS.2018.8362266
2018 52nd Annual Conference on Information Sciences and Systems (CISS)
Keywords
Field
DocType
Web robot characterization,Web robot,maximum likelihood estimation,Vuong test,heavy-tailed distribution
Web system,World Wide Web,Computer science,Server,Computer network,Feature extraction,Security policy,Robot,Web server
Conference
ISBN
Citations 
PageRank 
978-1-5386-0580-6
1
0.35
References 
Authors
0
2
Name
Order
Citations
PageRank
Mahdieh Zabihimayvan110.69
Derek Doran217021.22