This page shows selected joint member publications as well as technical reports published by SPEC RG. A more detailed list of publications by each working group of SPEC RG can be found in their respective subpage through the Working Groups link on the navigation side bar.
Highlighted Publications
- Samuel Kounev, Nikolas Herbst, Cristina L. Abad, Alexandru Iosup, Ian Foster, Prashant Shenoy, Omer Rana, Andrew A. Chien.
Serverless Computing: What It Is, and What It Is Not?. Commun. ACM 66, 9 (September 2023), 80–92. 2023.
DOI: 10.1145/3587249 - Simon Eismann, Diego Elias Costa, Lizhi Liao, Cor-Paul Bezemer, Weiyi Shang, André van Hoorn, Samuel Kounev.
A case study on the stability of performance tests for serverless applications. J. Syst. Softw., volume 189, pp. 111294. 2022.
DOI: 10.1016/j.jss.2022.111294 - Klervie Toczé, Norbert Schmitt, Ulf Kargén, Atakan Aral, Ivona Brandic.
Edge Workload Trace Gathering and Analysis for Benchmarking. 6th IEEE International Conference on Fog and Edge Computing, ICFEC, Messina, Italy, May 16-19, pp. 34-41. 2022.
DOI: 10.1109/ICFEC54809.2022.00012 - Simon Eismann, Long Bui, Johannes Grohmann, Cristina L. Abad, Nikolas Herbst, Samuel Kounev.
Sizeless: predicting the optimal size of serverless functions. Middleware '21: 22nd International Middleware Conference, Qu\'ebec City, Canada, December 6 - 10, pp. 248-259. 2021.
DOI: 10.1145/3464298.3493398 - Simon Eismann, Joel Scheuner, Erwin Van Eyk, Maximilian Schwinger, Johannes Grohmann, Nikolas Herbst, Cristina L. Abad, Alexandru Iosup.
Serverless Applications: Why, When, and How?. IEEE Softw., volume 38, pp. 32-39. 2021.
DOI: 10.1109/MS.2020.3023302 - Alessandro Vittorio Papadopoulos, Laurens Versluis, André Bauer, Nikolas Herbst, Jóakim von Kistowski, Ahmed Ali-Eldin, Cristina L. Abad, José Nelson Amaral, Petr Tuma, Alexandru Iosup.
Methodological Principles for Reproducible Performance Evaluation in Cloud Computing. IEEE Trans. Software Eng., volume 47, pp. 1528-1543. 2021.
DOI: 10.1109/TSE.2019.2927908 - Samuel Kounev, Klaus-Dieter Lange, Jóakim von Kistowski.
Systems Benchmarking For Scientists and Engineers. Springer International Publishing 2020, 421 pages, ISBN 978-3-030-41704-8. August 2020.
DOI: 10.1007/978-3-030-41705-5 - Simon Eismann, Cor-Paul Bezemer, Weiyi Shang, Dusan Okanovic, André van Hoorn.
Microservices: A Performance Tester's Dream or Nightmare?. ICPE '20: ACM/SPEC International Conference on Performance Engineering, Edmonton, AB, Canada, April 20-24, pp. 138-149. 2020.
DOI: 10.1145/3358960.3379124 - Jóakim von Kistowski, Klaus-Dieter Lange, Jeremy A. Arnold, John Beckett, Hansfried Block, Michael G. Tricker, Sanjay Sharma, Johann Pais, Samuel Kounev.
Measuring and rating the energy-efficiency of servers. Future Generation Computer Systems 100 (2019): 579-589. November 2019.
DOI: 10.1016/j.future.2019.05.050 - Jóakim von Kistowski, Johann Pais, Tobias Wahl, Klaus-Dieter Lange, Hansfried Block, John Beckett, Samuel Kounev.
Measuring the Energy Efficiency of Transactional Loads on GPGPU. In Proceedings of the 2019 ACM/SPEC International Conference on Performance Engineering (ICPE '19). April 2019.
DOI: 10.1145/3297663.3309667 - Cor-Paul Bezemer, Simon Eismann, Vincenzo Ferme, Johannes Grohmann, Robert Heinrich, Pooyan Jamshidi, Weiyi Shang, André van Hoorn, Mónica Villavicencio, Jürgen Walter, Felix Willnecker.
How is Performance Addressed in DevOps?. Proceedings of the ACM/SPEC International Conference on Performance Engineering, ICPE, Mumbai, India, April 7-11, pp. 45-50. 2019.
DOI: 10.1145/3297663.3309672 - Alexey Ilyushkin, Ahmed Ali-Eldin, Nikolas Herbst, André Bauer, Alessandro Vittorio Papadopoulos, Dick H. J. Epema, Alexandru Iosup.
An Experimental Performance Evaluation of Autoscalers for Complex Workflows. ACM Trans. Model. Perform. Evaluation Comput. Syst., volume 3, pp. 8:1-8:32. 2018.
DOI: 10.1145/3164537 - Jóakim von Kistowski, John Beckett, Klaus-Dieter Lange, Hansfried Block, Jeremy A. Arnold, Samuel Kounev.
Energy Efficiency of Hierarchical Server Load Distribution Strategies. IEEE 23rd International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, 2015, pp. 75-84. October 2015.
DOI: 10.1109/MASCOTS.2015.11 - Klaus-Dieter Lange, Jeremy A. Arnold, Hansfried Block, Nathan Totura, John Beckett, Michael G. Tricker.
Further implementation aspects of the server efficiency rating tool (SERT). In Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering (ICPE '13). April 2013.
DOI: 10.1145/2479871.2479926
Technical Reports
- Simon Eismann, Joel Scheuner, Erwin van Eyk, Maximilian Schwinger, Johannes Grohmann, Nikolas Herbst, Cristina L. Abad, Alexandru Iosup.
A Review of Serverless Use Cases and their Characteristics. May 2020.
News announcement - Alessandro Vittorio Papadopoulos, Laurens Versluis, André Bauer, Nikolas Herbst, Jóakim von Kistowski, Ahmed Ali-Eldin, Cristina Abad, J. Nelson Amaral, Petr Tuma, Alexandru Iosup.
Methodological Principles for Reproducible Performance Evaluation in Cloud Computing. A SPEC Research Technical Report. April 2019.
News announcement - Nikolas Herbst, Rouven Krebs, Giorgos Oikonomou, George Kousiouris, Athanasia Evangelinou, Alexandru Iosup, Samuel Kounev.
Ready for Rain? A View from SPEC Research on the Future of Cloud Metrics. Technical Report SPEC-RG-2016-01, SPEC Research Group - Cloud Working Group, Standard Performance Evaluation Corporation (SPEC). March 2016.
More... - Andreas Brunnert, André van Hoorn, Felix Willnecker, Alexandru Danciu, Wilhelm Hasselbring, Christoph Heger, Nikolas Herbst, Pooyan Jamshidi, Reiner Jung, Joakim von Kistowski, Anne Koziolek, Johannes Kroß, Simon Spinner, Christian Vögele, Jürgen Walter, Alexander Wert.
Performance-oriented DevOps: A Research Agenda. Technical Report SPEC-RG-2015-01, SPEC Research Group - DevOps Performance Working Group, Standard Performance Evaluation Corporation (SPEC). August 2015.
More... - Aleksandar Milenkoski, Marco Vieira, Bryan D. Payne, Nuno Antunes, Samuel Kounev.
Technical Information on Vulnerabilities of Hypercall Handlers. Technical Report SPEC-RG-2014-001 v.1.0, SPEC Research Group - IDS Benchmarking Working Group, Standard Performance Evaluation Corporation (SPEC). August 2014.
More... - Aleksandar Milenkoski, Samuel Kounev, Alberto Avritzer, Nuno Antunes, Marco Vieira.
On Benchmarking Intrusion Detection Systems in Virtualized Environments. Technical Report SPEC-RG-2013-002 v.1.0, SPEC Research Group - IDS Benchmarking Working Group, Standard Performance Evaluation Corporation (SPEC). June 2013.
More... - Aleksandar Milenkoski, Alexandru Iosup, Samuel Kounev, Kai Sachs, Piotr Rygielski, Jason Ding, Walfredo Cirne, Florian Rosenberg.
Cloud Usage Patterns: A Formalism for Description of Cloud Usage Scenarios. Technical Report SPEC-RG-2013-001 v.1.0.1, SPEC Research Group - Cloud Working Group, Standard Performance Evaluation Corporation (SPEC). May 2013.
More...