Title
An Architecture and Methods for Big Data Analysis
Abstract
Data production has recently witnessed explosive growth, reaching an insurmountable amount (larger than 4 ZB in 2013). This includes data sources such as sensors used to gather climate information, reports on household parameters, posts to social media sites containing digital pictures and videos, purchase transaction records, and cell phone GPS signals, to name a few. Not yet having more than an intuitive and ad hoc definition, big data is challenging the IT infrastructure of companies and organizations, forcing them to look for viable solutions leading to data processing such that enterprises can deploy a better business strategy. In essence, big data implies collecting, extracting, transforming, transporting, loading (ETL), classifying, analyzing, interpreting, and visualizing, among many other operations, on large amounts of structured, semi-structured, and unstructured data, in the order of a few petabytes per day, executed and terminated in critical time. This paper will introduce the architecture and the corresponding functions of a platform and tools implementing part of these challenging operations, while others are being obtained via composing elementary operations. The architecture is built around a distributed network of virtual servers called "agents," which can migrate around a network of hardware servers whenever available resources are provided or created. A control center makes decisions on moving the agents based on the availability of resources when needed. An example from the telecommunications industry will illustrate how the platform is applied to this domain of big data.
Year
DOI
Venue
2014
10.1007/978-3-319-18296-4_39
SOFT COMPUTING APPLICATIONS, (SOFA 2014), VOL 1
Field
DocType
Volume
Data science,Data processing,Computer science,Petabyte,Server,Domain Name System,Unstructured data,Phone,Information technology management,Artificial intelligence,Big data,Machine learning
Conference
356
ISSN
Citations 
PageRank 
2194-5357
1
0.35
References 
Authors
1
5
Name
Order
Citations
PageRank
Bogdan Ionescu145856.67
Dan Ionescu2103.56
Cristian Gadea3378.40
Bogdan Solomon4476.54
Mircea Trifan541.75