Alberta Workloads

Description

The intent of these new workloads is to enable a more complete evaluation of techniques that depend on information gathered during previous executions of the same program such as compilation that use feedback directed optimization and architectural proposals that use automated learning. These additional workloads are not intended to be used for performance measurements that would be subsequently used to compare computing platforms for the sake of commercial or advertising claims. These additional workloads also cannot be used to produce performance results that are submitted for official publication in the SPEC website. For that you must follow the rules published by the SPEC Open Systems Group.

To assist researchers with the selection of inputs for their experiments, an initial evaluation of the effect of the change in inputs on the behaviour of the benchmark programs is also included in this website. While incomplete, this initial performance study can be used to determine, for instance, which program behaviours are more sensitive to changes in the program inputs.

A likely user of these workloads will be setting up an experimental environment that is different than the one use by runcpu to generate standarized results. Such a user should still be familiar with several aspects of the process for building and running a benchmark. The SPEC CPU 2017 suite distribution includes the Avoiding runcpu documentation that shall be relevant for such user.

Requirements

The requirements are stated separately for each script in the distribution.

Website

https://webdocs.cs.ualberta.ca/~amaral/AlbertaWorkloadsForSPECCPU2017/

Contributors

  • José Nelson Amaral - University of Alberta
  • Edson Borin - Universidade de Campinas
  • Dylan R. Ashley - University of Alberta
  • Caian Benedicto - Universidade de Campinas
  • Elliot Colp - University of Alberta
  • João Henrique Stange Hoffmam - Universidade de Campinas
  • Marcus Karpoff - University of Alberta
  • Erick Ochoa - University of Alberta
  • Morgan Redshaw - University of Alberta
  • Raphael Ernani Rodrigues - University of Alberta

Maintainers

  • José Nelson Amaral, jamaral(at)ualberta.ca
    University of Alberta
    Edmonton, AB, Canada

Version

November 2018

License

The license is stated separately for each script in the distribution.

Downloads

There is no all-in-one download, user is expected to download each workload separately from the homepage.

Related publications and projects

  • José Nelson Amaral, Edson Borin, Dylan R. Ashley, Caian Benedicto, Elliot Colp, João Henrique Stange Hoffmam, Marcus Karpoff, Erick Ochoa, Morgan Redshaw, Raphael Ernani Rodrigues, The Alberta Workloads for the SPEC CPU 2017 Benchmark Suite, International Symposium on Performance Analysis of Systems and Software, Belfast, Northern Ireland, April, 2018.