Title
Memory-Optimised Parallel Processing of Hi-C Data
Abstract
This paper presents the optimisation efforts on the creation of a graph-based mapping representation of gene adjacency. The method is based on the Hi-C process, starting from Next Generation Sequencing data, and it analyses a huge amount of static data in order to produce maps for one or more genes. Straightforward parallelisation of this scheme does not yield acceptable performance on multicore architectures since the scalability is rather limited due to the memory bound nature of the problem. This work focuses on the memory optimisations that can be applied to the graph construction algorithm and its (complex) data structures to derive a cache-oblivious algorithm and eventually to improve the memory bandwidth utilisation. We used as running example not, a tool for annotation and statistic analysis of Hi-C data that creates a gene-centric neighborhood graph. The proposed approach, which is exemplified for Hi-C, addresses several common issue in the parallelisation of memory bound algorithms for multicore. Results show that the proposed approach is able to increase the parallel speedup from 7x to 22x (on a 32-core platform). Finally, the proposed C++ implementation outperforms the first R Nu Chart prototype, by which it was not possible to complete the graph generation because of strong memory-saturation problems.
Year
DOI
Venue
2015
10.1109/PDP.2015.63
PDP
Field
DocType
ISSN
Adjacency list,Data structure,Graph database,Memory bandwidth,Computer science,Parallel computing,Chart,Multi-core processor,Speedup,Distributed computing,Scalability
Conference
1066-6192
Citations 
PageRank 
References 
1
0.43
6
Authors
5
Name
Order
Citations
PageRank
Maurizio Drocco18812.09
Claudia Misale2235.44
Guilherme Peretti Pezzi3212.79
Fabio Tordini443.28
Marco Aldinucci563859.87