Title
A parallelism-based analytic approach to performance evaluation using application programs
Abstract
In this paper we present a brief overview of performance evaluation and benchmarking. We demonstrate that traditional performance measurements recorded in these activities are really a direct measurement of the parallelism in software and hardware. A framework called the Path to Performance is developed that identifies the agents and activities that change the parallelism as it moves from problem to solution. We show where various current application benchmarks apply probes on the Path and which agents am being measured. We recast the traditional time-based performance measurements into parallelism-based performance measurements to show that understanding performance implies understanding the parallelism. A simulation tool and methodology are described for measuring and comparing the executed parallelism on a single CRAY Y-MP CPU. We apply our methodology to several of the Perfect Benchmarks to quantify their executed parallelism on this machine. Our results suggest that since some of the benchmarks have a similar mix of different levels of parallelism on the Y-MP, the benchmarking utility of these programs on the Y-MP may be questioned because they exercise the machine in the same way.
Year
DOI
Venue
1993
10.1109/5.236190
Proceedings of The IEEE
Keywords
DocType
Volume
parallel machines,parallel programming,performance evaluation,program testing,CRAY Y-MP CPU,Path to Performance,Perfect Benchmarks,application benchmarks,application programs,benchmarking,benchmarking utility,parallelism-based analytic approach,parallelism-based performance measurements,performance evaluation,probes,simulation tool
Journal
81
Issue
ISSN
Citations 
8
0018-9219
6
PageRank 
References 
Authors
0.74
3
2
Name
Order
Citations
PageRank
D. K. Bradley160.74
J. L. Larson2264.12