This page shows selected joint member publications as well as technical reports published by SPEC RG. A more detailed list of publications by each working group of SPEC RG can be found in their respective subpage through the Working Groups link on the navigation side bar.

Highlighted Publications

  • Auday Al-Dulaimy, Matthijs Jansen, Bjarne Johansson, Animesh Trivedi, Alexandru Iosup, Mohammad Ashjaei, Antonino Galletta, Dragi Kimovski, Radu Prodan, Konstantinos Tserpes, George Kousiouris, Chris Giannakos, Ivona Brandic, Nawfal Ali, André B. Bondi, Alessandro V. Papadopoulos.
    The computing continuum: From IoT to the cloud. Internet of Things, 27, p.101272. 2024.
    DOI: 10.1016/j.iot.2024.101272
  • Samuel Kounev, Nikolas Herbst, Cristina L. Abad, Alexandru Iosup, Ian Foster, Prashant Shenoy, Omer Rana, Andrew A. Chien.
    Serverless Computing: What It Is, and What It Is Not?. Commun. ACM 66, 9 (September 2023), 80–92. 2023.
    DOI: 10.1145/3587249
  • Simon Eismann, Diego Elias Costa, Lizhi Liao, Cor-Paul Bezemer, Weiyi Shang, André van Hoorn, Samuel Kounev.
    A case study on the stability of performance tests for serverless applications. J. Syst. Softw., volume 189, pp. 111294. 2022.
    DOI: 10.1016/j.jss.2022.111294
  • Simon Eismann, Long Bui, Johannes Grohmann, Cristina L. Abad, Nikolas Herbst, Samuel Kounev.
    Sizeless: predicting the optimal size of serverless functions. Middleware '21: 22nd International Middleware Conference, Qu\'ebec City, Canada, December 6 - 10, pp. 248-259. 2021.
    DOI: 10.1145/3464298.3493398
  • Simon Eismann, Joel Scheuner, Erwin Van Eyk, Maximilian Schwinger, Johannes Grohmann, Nikolas Herbst, Cristina L. Abad, Alexandru Iosup.
    Serverless Applications: Why, When, and How?. IEEE Softw., volume 38, pp. 32-39. 2021.
    DOI: 10.1109/MS.2020.3023302
  • Alessandro Vittorio Papadopoulos, Laurens Versluis, André Bauer, Nikolas Herbst, Jóakim von Kistowski, Ahmed Ali-Eldin, Cristina L. Abad, José Nelson Amaral, Petr Tuma, Alexandru Iosup.
    Methodological Principles for Reproducible Performance Evaluation in Cloud Computing. IEEE Trans. Software Eng., volume 47, pp. 1528-1543. 2021.
    DOI: 10.1109/TSE.2019.2927908
  • Samuel Kounev, Klaus-Dieter Lange, Jóakim von Kistowski.
    Systems Benchmarking For Scientists and Engineers. Springer International Publishing 2020, 421 pages, ISBN 978-3-030-41704-8. August 2020.
    DOI: 10.1007/978-3-030-41705-5
  • Simon Eismann, Cor-Paul Bezemer, Weiyi Shang, Dusan Okanovic, André van Hoorn.
    Microservices: A Performance Tester's Dream or Nightmare?. ICPE '20: ACM/SPEC International Conference on Performance Engineering, Edmonton, AB, Canada, April 20-24, pp. 138-149. 2020.
    DOI: 10.1145/3358960.3379124
  • Jóakim von Kistowski, Klaus-Dieter Lange, Jeremy A. Arnold, John Beckett, Hansfried Block, Michael G. Tricker, Sanjay Sharma, Johann Pais, Samuel Kounev.
    Measuring and rating the energy-efficiency of servers. Future Generation Computer Systems 100 (2019): 579-589. November 2019.
    DOI: 10.1016/j.future.2019.05.050
  • Cor-Paul Bezemer, Simon Eismann, Vincenzo Ferme, Johannes Grohmann, Robert Heinrich, Pooyan Jamshidi, Weiyi Shang, André van Hoorn, Mónica Villavicencio, Jürgen Walter, Felix Willnecker.
    How is Performance Addressed in DevOps?. Proceedings of the ACM/SPEC International Conference on Performance Engineering, ICPE, Mumbai, India, April 7-11, pp. 45-50. 2019.
    DOI: 10.1145/3297663.3309672
  • Alexey Ilyushkin, Ahmed Ali-Eldin, Nikolas Herbst, André Bauer, Alessandro Vittorio Papadopoulos, Dick H. J. Epema, Alexandru Iosup.
    An Experimental Performance Evaluation of Autoscalers for Complex Workflows. ACM Trans. Model. Perform. Evaluation Comput. Syst., volume 3, pp. 8:1-8:32. 2018.
    DOI: 10.1145/3164537

Technical Reports

  • Simon Eismann, Joel Scheuner, Erwin van Eyk, Maximilian Schwinger, Johannes Grohmann, Nikolas Herbst, Cristina L. Abad, Alexandru Iosup.
    A Review of Serverless Use Cases and their Characteristics. May 2020.
    News announcement
  • Alessandro Vittorio Papadopoulos, Laurens Versluis, André Bauer, Nikolas Herbst, Jóakim von Kistowski, Ahmed Ali-Eldin, Cristina Abad, J. Nelson Amaral, Petr Tuma, Alexandru Iosup.
    Methodological Principles for Reproducible Performance Evaluation in Cloud Computing. A SPEC Research Technical Report. April 2019.
    News announcement
  • Nikolas Herbst, Rouven Krebs, Giorgos Oikonomou, George Kousiouris, Athanasia Evangelinou, Alexandru Iosup, Samuel Kounev.
    Ready for Rain? A View from SPEC Research on the Future of Cloud Metrics. Technical Report SPEC-RG-2016-01, SPEC Research Group - Cloud Working Group, Standard Performance Evaluation Corporation (SPEC). March 2016.
    More...
  • Andreas Brunnert, André van Hoorn, Felix Willnecker, Alexandru Danciu, Wilhelm Hasselbring, Christoph Heger, Nikolas Herbst, Pooyan Jamshidi, Reiner Jung, Joakim von Kistowski, Anne Koziolek, Johannes Kroß, Simon Spinner, Christian Vögele, Jürgen Walter, Alexander Wert.
    Performance-oriented DevOps: A Research Agenda. Technical Report SPEC-RG-2015-01, SPEC Research Group - DevOps Performance Working Group, Standard Performance Evaluation Corporation (SPEC). August 2015.
    More...
  • Aleksandar Milenkoski, Marco Vieira, Bryan D. Payne, Nuno Antunes, Samuel Kounev.
    Technical Information on Vulnerabilities of Hypercall Handlers. Technical Report SPEC-RG-2014-001 v.1.0, SPEC Research Group - IDS Benchmarking Working Group, Standard Performance Evaluation Corporation (SPEC). August 2014.
    More...
  • Aleksandar Milenkoski, Samuel Kounev, Alberto Avritzer, Nuno Antunes, Marco Vieira.
    On Benchmarking Intrusion Detection Systems in Virtualized Environments. Technical Report SPEC-RG-2013-002 v.1.0, SPEC Research Group - IDS Benchmarking Working Group, Standard Performance Evaluation Corporation (SPEC). June 2013.
    More...
  • Aleksandar Milenkoski, Alexandru Iosup, Samuel Kounev, Kai Sachs, Piotr Rygielski, Jason Ding, Walfredo Cirne, Florian Rosenberg.
    Cloud Usage Patterns: A Formalism for Description of Cloud Usage Scenarios. Technical Report SPEC-RG-2013-001 v.1.0.1, SPEC Research Group - Cloud Working Group, Standard Performance Evaluation Corporation (SPEC). May 2013.
    More...