Title
Efficient communication and collection with compact normal forms
Abstract
In distributed applications, the transmission of non-contiguous data structures is greatly slowed down by the need to serialize them into a buffer before sending. We describe Compact Normal Forms, an API that allows programmers to explicitly place immutable heap objects into regions, which can both be accessed like ordinary data as well as efficiently transmitted over the network. The process of placing objects into compact regions (essentially a copy) is faster than any serializer and can be amortized over a series of functional updates to the data structure in question. We implement this scheme in the Glasgow Haskell Compiler and show that even with the space expansion attendant with memory-oriented data structure representations, we achieve between x2 and x4 speedups on fast local networks with sufficiently large data structures.
Year
DOI
Venue
2015
10.1145/2784731.2784735
International Conf on Function Programming
Keywords
Field
DocType
Message Passing,Regions,Serialization
Data structure,Programming language,Serialization,Computer science,Parallel computing,Heap (data structure),Theoretical computer science,Serializer,Compiler,Haskell,Message passing
Conference
Volume
Issue
ISSN
50
9
0362-1340
Citations 
PageRank 
References 
1
0.35
21
Authors
6
Name
Order
Citations
PageRank
Edward Z. Yang1934.68
Giovanni Campagna294.60
Ömer S. Agacan381.29
Ahmed El-Hassany4302.69
Abhishek Kulkarni5576.33
Ryan Newton680270.80