Title
A Distributed Recommendation Platform for Big Data.
Abstract
The vast amount of information that recommenders manage these days has reached a point where scalability has become a critical factor. In this work, we propose a scalable architecture designed for computing Collaborative Filtering recommendations in a Big Data scenario. In order to build a highly scalable and fault-tolerant platform, we employ fully distributed systems without any single point of failure. We study the use of data replication and data distribution technologies. Additionally, we consider different caching techniques. Taking into account these requirements, we propose particular technologies for each component of the platform. Next, we evaluate the response times of storing, generating and serving recommendations using MySQL Cluster and Cassandra showing that the latter technology is much more adequate for that purpose. Finally, we conduct a simulation for evaluating the impact of a memory caching system.
Year
Venue
Keywords
2015
JOURNAL OF UNIVERSAL COMPUTER SCIENCE
Recommender systems,big data,scalability,architecture,NoSQL,cache
Field
DocType
Volume
Data science,Computer science,Knowledge management,Big data
Journal
21
Issue
ISSN
Citations 
13
0948-695X
2
PageRank 
References 
Authors
0.37
2
3
Name
Order
Citations
PageRank
Daniel Valcarce1548.51
Javier Parapar218825.91
Alvaro Barreiro322622.42