Title
Evaluating the impact of the simulation environment on experimentation results
Abstract
Simulation has become the tool of choice for advanced computer architecture research. Simulation model abstraction as well as compiler specifics can have significant impact on the observed performance trends and may lead to incorrect conclusions. This study presents a methodology that compares the predicted performance impact of several architectural techniques measured on a variety of simulator and compiler configurations. A significant difference in speedup between experiments indicates that a technique is sensitive to this particular variation. The results demonstrate a strong but non-uniform relationship between modeling abstraction and measurement error, as well as a significant sensitivity to the compiler.
Year
DOI
Venue
2005
10.1016/j.peva.2004.11.002
Perform. Eval.
Keywords
Field
DocType
architectural simulation,significant difference,experimentation result,compiler optimization,compiler specific,observed performance trend,significant impact,simulator accuracy,modeling error,simulation environment,performance impact,compiler configuration,significant sensitivity,advanced computer architecture research,execution-driven simulator,simulation model abstraction,architectural technique,simulation model,measurement error,computer architecture
Abstraction,Computer architecture simulator,Computer science,Optimizing compiler,Real-time computing,Compiler,Observational error,Speedup
Journal
Volume
Issue
ISSN
61
4
Performance Evaluation
Citations 
PageRank 
References 
1
0.36
10
Authors
1
Name
Order
Citations
PageRank
Lambert Schaelicke127920.23