Title
A multi-layered performance analysis for cloud-based topic detection and tracking in Big Data applications.
Abstract
In the era of the Internet of Things and social media; communities, governments, and corporations are increasingly eager to exploit new technological innovations in order to track and keep up to date with important new events. Examples of such events include the news, health related incidents, and other major occurrences such as earthquakes and landslides. This area of research commonly referred to as Topic Detection and Tracking (TDT) is proving to be an important component of the current generation of Internet-based applications, where it is of critical importance to have early detection and timely response to important incidents such as those mentioned above. The advent of Big data though beneficial to TDT applications also brings about the enormous challenge of dealing with data variety, velocity and volume (3Vs). A promising solution is to employ Cloud Computing, which enables users to access powerful and scalable computational and storage resources in a “pay-as-you-go” fashion. However, the efficient use of Cloud resources to boost the performance of mission critical applications employing TDT is still an open topic that has not been fully and effectively investigated. An important prerequisite is to build a performance analysis capable of capturing and explaining specific factors (for example; CPU, Memory, I/O, Network, Cloud Platform Service, and Workload) that influence the performances of TDT applications in the cloud. Within this paper, our main contribution, is that we present a multi-layered performance analysis for big data TDT applications deployed in a cloud environment. Our analysis captures factors that have an important effect on the performance of TDT applications. The novelty of our work is that it is a first kind of vertical analysis on infrastructure, platform and software layers. We identify key parameters and metrics in each cloud layer (including Infrastructure, Software, and Platform layers), and establish the dependencies between these metrics across the layers. We demonstrate the effectiveness of the proposed analysis via experimental evaluations using real-world datasets obtained from Twitter.
Year
DOI
Venue
2018
10.1016/j.future.2018.01.047
Future Generation Computer Systems
Keywords
Field
DocType
Cloud-based TDT,Big Data,Performance analysis,Cloud computing
Computer science,Exploit,Software,Mission critical,Abstraction layer,Big data,The Internet,Scalability,Cloud computing,Distributed computing
Journal
Volume
ISSN
Citations 
87
0167-739X
2
PageRank 
References 
Authors
0.37
16
8
Name
Order
Citations
PageRank
Meisong Wang1221.92
Prem Prakash Jayaraman237844.66
Ellis Solaiman38714.54
Lydia Y. Chen443252.24
Zheng Li5508.75
Jun Song630.72
Dimitrios Georgakopoulos72554580.54
Rajiv Ranjan84747267.72