Title
A Sparse Tensor Benchmark Suite for CPUs and GPUs
Abstract
Tensor computations present significant performance challenges that impact a wide spectrum of applications ranging from machine learning, healthcare analytics, social network analysis, data mining to quantum chemistry and signal processing. Efforts to improve the performance of tensor computations include exploring data layout, execution scheduling, and parallelism in common tensor kernels. This work presents a benchmark suite for arbitrary-order sparse tensor kernels using state-of-the-art tensor formats: coordinate (COO) and hierarchical coordinate (HiCOO) on CPUs and GPUs. It presents a set of reference tensor kernel implementations that are compatible with real-world tensors and power law tensors extended from synthetic graph generation techniques. We also propose Roofline performance models for these kernels to provide insights of computer platforms from sparse tensor view. This benchmark suite along with the synthetic tensor generator is publicly available.
Year
DOI
Venue
2020
10.1109/IISWC50251.2020.00027
2020 IEEE International Symposium on Workload Characterization (IISWC)
Keywords
DocType
ISBN
sparse tensors,benchmarking,data analysis,tensor decomposition,GPU
Conference
978-1-7281-7646-8
Citations 
PageRank 
References 
1
0.37
27
Authors
6
Name
Order
Citations
PageRank
Jiajia Li131734.53
Mahesh Lakshminarasimhan210.70
Xiaolong Wu363.14
Ang Li420129.68
Catherine Olschanowsky510.37
Kevin Barker6514.46