Technical Report on "Reproducible Performance Evaluation in Cloud Computing" Published

Monday, April 1, 2019 20:55

The SPEC RG Cloud Working Group has published a Technical Report on "Methodological Principles for Reproducible Performance Evaluation in Cloud Computing"

The rapid adoption and the diversification of cloud computing technology exacerbate the importance of a sound experimental methodology for this domain.

This work investigates how to measure and report performance in the cloud, and how well the cloud research community is already doing it.

We propose a set of eight important methodological principles that combine best-practices from nearby fields with concepts applicable only to clouds, and with new ideas about the time-accuracy trade-off.

\

We conclude that, although these important principles are simple and basic, the cloud community is yet to adopt them broadly to deliver sound measurement of cloud environments.

The technical report can be found here.