Title
Scratchpad-Memory Management for Multi-Threaded Applications on Many-Core Architectures.
Abstract
Contemporary many-core architectures, such as Adapteva Epiphany and Sunway TaihuLight, employ per-core software-controlled Scratchpad Memory (SPM) rather than caches for better performance-per-watt and predictability. In these architectures, a core is allowed to access its own SPM as well as remote SPMs through the Network-On-Chip (NoC). However, the compiler/programmer is required to explicitly manage the movement of data between SPMs and off-chip memory. Utilizing SPMs for multi-threaded applications is even more challenging, as the shared variables across the threads need to be placed appropriately. Accessing variables from remote SPMs with higher access latency further complicates this problem as certain links in the NoC may be heavily contended by multiple threads. Therefore, certain variables may need to be replicated in multiple SPMs to reduce the contention delay and/or the overall access time. We present Coordinated Data Management (CDM), a compile-time framework that automatically identifies shared/private variables and places them with replication (if necessary) to suitable on-chip or off-chip memory, taking NoC contention into consideration. We develop both an exact Integer Linear Programming (ILP) formulation as well as an iterative, scalable algorithm for placing the data variables in multi-threaded applications on many-core SPMs. Experimental evaluation on the Parallella hardware platform confirms that our allocation strategy reduces the overall execution time and energy consumption by 1.84× and 1.83×, respectively, when compared to the existing approaches.
Year
DOI
Venue
2019
10.1145/3301308
ACM Trans. Embedded Comput. Syst.
Keywords
Field
DocType
Scratchpad memory management, many-core architectures
Programmer,Access time,Computer science,Scratchpad memory,Parallel computing,Compiler,Thread (computing),Integer programming,Data management,Energy consumption,Distributed computing
Journal
Volume
Issue
ISSN
18
1
1539-9087
Citations 
PageRank 
References 
3
0.38
40
Authors
3
Name
Order
Citations
PageRank
Vanchinathan Venkataramani1765.85
Mun Choon Chan2113097.54
Tulika Mitra32714135.99