Paper Info
Title
Big Data Processing: Big Challenges And Opportunities
Abstract
With the rapid growth of emerging applications like social network, semantic web, sensor networks and LBS (Location Based Service) applications, a variety of data to be processed continues to witness a quick increase. Effective management and processing of large-scale data poses an interesting but critical challenge. Recently, big data has attracted a lot of attention from academia, industry as well as government. This paper introduces several big data processing techniques from system and application aspects. First, from the view of cloud data management and big data processing mechanisms, we present the key issues of big data processing, including definition of big data, big data management platform, big data service models, distributed file system, data storage, data virtualization platform and distributed applications. Following the MapReduce parallel processing framework, we introduce some MapReduce optimization strategies reported in the literature. Finally, we discuss the open issues and challenges, and deeply explore the research directions in the future on big data processing in cloud computing environments.
Year
DOI
Venue
2012
10.1142/S0219265912500090
JOURNAL OF INTERCONNECTION NETWORKS
Keywords
DocType
Volume
Big data, cloud computing, data management, distributed processing
Journal
13
Issue
ISSN
Citations 
3-4
0219-2659
2
PageRank 
References 
Authors
0.58
42
8
Name
Order
Citations
PageRank
Changqing Ji1666.31
Yu Li220.91
Wenming Qiu3101.15
Yingwei Jin46113.62
Yujie Xu59411.64
Uchechukwu Awada641.97
Keqiu Li71415162.02
Wenyu Qu857666.94