Paper Info
Title
CAF: Core to Core Communication Acceleration Framework.
Abstract
As the number of cores in a multicore system increases, core-to-core (C2C) communication is increasingly limiting the performance scaling of workloads that share data frequently. The traditional way cores communicate is by using shared memory space between them. However, shared memory communication fundamentally involves coherence invalidations and cache misses, which cause large performance overheads and incur a high amount of network traffic. Many important workloads incur significant C2C communication and are affected significantly by the costs, including pipelined packet processing which is widely used in software-based networking solutions. In these workloads, threads run on different cores and pass packets from one core to another for different stages of processing using software queues. In this paper, we analyze the behavior and overheads of software queue management. Based on this analysis, we propose a novel C2C Communication Acceleration Framework (CAF) to optimize C2C communication. CAF offloads substantial communication burdens from cores and memory to a designated, efficient hardware device we refer to as Queue Management Device (QMD) attached to the Network on Chip. CAF combines hardware and software optimizations to effectively reduce the queue-induced communication overheads and improve the overall system performance by up to 2-12x over traditional software queue implementations.
Year
DOI
Venue
2016
10.1145/2967938.2967954
PACT
Keywords
Field
DocType
Hardware queue, multicore communication, hardware accelerator
Shared memory,Computer science,Cache,Network packet,Parallel computing,Network on a chip,Real-time computing,Packet processing,Hardware acceleration,Queue management system,Multi-core processor
Conference
ISBN
Citations 
PageRank 
978-1-5090-5308-7
7
0.47
References 
Authors
27
5
Name
Order
Citations
PageRank
Yipeng Wang121625.38
Ren Wang2868.85
Andrew Herdrich3494.10
James Tsai4394.26
Yan Solihin52057111.56