Highlighted Publications

Selected joint member publications as well as technical reports published by SPEC RG are available at the publication page.

Group Publications

In the following, we list a selection of relevant publications by members of the RG Cloud working group.

Serverless

Cristina L. Abad, Ian T. Foster, Nikolas Herbst, Alexandru Iosup.
Serverless Computing (Dagstuhl Seminar 21201). 2021.
DOI: 10.4230/DagRep.11.4.34
Simon Eismann, Long Bui, Johannes Grohmann, Cristina L. Abad, Nikolas Herbst, Samuel Kounev.
Sizeless: predicting the optimal size of serverless functions. Middleware '21: 22nd International Middleware Conference, Qu\'ebec City, Canada, December 6 - 10, pp. 248-259. 2021.
DOI: 10.1145/3464298.3493398
Simon Eismann, Joel Scheuner, Erwin Van Eyk, Maximilian Schwinger, Johannes Grohmann, Nikolas Herbst, Cristina L. Abad, Alexandru Iosup.
Serverless Applications: Why, When, and How?. IEEE Softw., volume 38, pp. 32-39. 2021.
DOI: 10.1109/MS.2020.3023302
Simon Eismann, Joel Scheuner, Erwin Van Eyk, Maximilian Schwinger, Johannes Grohmann, Nikolas Herbst, Cristina L. Abad, Alexandru Iosup.
The State of Serverless Applications: Collection, Characterization, and Community Consensus. IEEE Transactions on Software Engineering. 2021.
DOI: 10.1109/TSE.2021.3113940
Simon Eismann, Johannes Grohmann, Erwin Van Eyk, Nikolas Herbst, Samuel Kounev.
Predicting the Costs of Serverless Workflows. ICPE '20: ACM/SPEC International Conference on Performance Engineering, Edmonton, AB, Canada, April 20-24, pp. 265-276. 2020.
DOI: 10.1145/3358960.3379133
Erwin Van Eyk, Joel Scheuner, Simon Eismann, Cristina L. Abad, Alexandru Iosup.
Beyond Microbenchmarks: The SPEC-RG Vision for a Comprehensive Serverless Benchmark. Companion of the ACM/SPEC International Conference on Performance Engineering, ICPE, Edmonton, AB, Canada, April 20-24, pp. 26-31. 2020.
DOI: 10.1145/3375555.3384381
Erwin Van Eyk, Alexandru Iosup, Johannes Grohmann, Simon Eismann, André Bauer, Laurens Versluis, Lucian Toader, Norbert Schmitt, Nikolas Herbst, Cristina L. Abad.
The SPEC-RG Reference Architecture for FaaS: From Microservices and Containers to Serverless Platforms. IEEE Internet Comput., volume 23, pp. 7-18. 2019.
DOI: 10.1109/MIC.2019.2952061
Erwin Van Eyk, Alexandru Iosup, Cristina L. Abad, Johannes Grohmann, Simon Eismann.
A SPEC RG Cloud Group's Vision on the Performance Challenges of FaaS Cloud Architectures. Companion of the ACM/SPEC International Conference on Performance Engineering, ICPE, Berlin, Germany, April 09-13, pp. 21-24. 2018.
DOI: 10.1145/3185768.3186308

Cloud Autoscaling

André Bauer, Nikolas Herbst, Simon Spinner, Ahmed Ali-Eldin, Samuel Kounev.
Chameleon: A Hybrid, Proactive Auto-Scaling Mechanism on a Level-Playing Field. IEEE Trans. Parallel Distributed Syst., volume 30, pp. 800-813. 2019.
DOI: 10.1109/TPDS.2018.2870389
André Bauer, Veronika Lesch, Laurens Versluis, Alexey Ilyushkin, Nikolas Herbst, Samuel Kounev.
Chamulteon: Coordinated Auto-Scaling of Micro-Services. 39th IEEE International Conference on Distributed Computing Systems, ICDCS, Dallas, TX, USA, July 7-10, pp. 2015-2025. 2019.
DOI: 10.1109/ICDCS.2019.00199
Alexey Ilyushkin, Ahmed Ali-Eldin, Nikolas Herbst, André Bauer, Alessandro Vittorio Papadopoulos, Dick H. J. Epema, Alexandru Iosup.
An Experimental Performance Evaluation of Autoscalers for Complex Workflows. ACM Trans. Model. Perform. Evaluation Comput. Syst., volume 3, pp. 8:1-8:32. 2018.
DOI: 10.1145/3164537
Alexey Ilyushkin, Ahmed Ali-Eldin, Nikolas Herbst, Alessandro Vittorio Papadopoulos, Bogdan Ghit, Dick H. J. Epema, Alexandru Iosup.
An Experimental Performance Evaluation of Autoscaling Policies for Complex Workflows. Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering, ICPE, L'Aquila, Italy, April 22-26, pp. 75-86. 2017.
DOI: 10.1145/3030207.3030214

Edge

Klervie Toczé, Norbert Schmitt, Ulf Kargén, Atakan Aral, Ivona Brandic.
Edge Workload Trace Gathering and Analysis for Benchmarking. 6th IEEE International Conference on Fog and Edge Computing, ICFEC, Messina, Italy, May 16-19, pp. 34-41. 2022.
DOI: 10.1109/ICFEC54809.2022.00012
Klervie Toczé, Norbert Schmitt, Ivona Brandic, Atakan Aral, Simin Nadjm-Tehrani.
Towards Edge Benchmarking: A Methodology for Characterizing Edge Workloads. IEEE 4th International Workshops on Foundations and Applications of Self* Systems, FAS*W@SASO/ICCAC, Umea, Sweden, June 16-20, pp. 70-71. 2019.
DOI: 10.1109/FAS-W.2019.00030

Education

Cristina L. Abad, Alexandru Iosup, Edwin F. Boza, Eduardo Ortiz-Holguin.
An Analysis of Distributed Systems Syllabi With a Focus on Performance-Related Topics. ICPE '21: ACM/SPEC International Conference on Performance Engineering, Virtual Event, France, April 19-21, Companion Volume, pp. 121-126. 2021.
DOI: 10.1145/3447545.3451197

Performance, Dependability, and Other Metrics

Nikolas Herbst, André Bauer, Samuel Kounev, Giorgos Oikonomou, Erwin Van Eyk, George Kousiouris, Athanasia Evangelinou, Rouven Krebs, Tim Brecht, Cristina L. Abad, Alexandru Iosup.
Quantifying Cloud Performance and Dependability: Taxonomy, Metric Design, and Emerging Challenges. ACM Trans. Model. Perform. Evaluation Comput. Syst., volume 3, pp. 19:1-19:36. 2018.
DOI: 10.1145/3236332

Performance Variability and Reproducibility

Alessandro Vittorio Papadopoulos, Laurens Versluis, André Bauer, Nikolas Herbst, Jóakim von Kistowski, Ahmed Ali-Eldin, Cristina L. Abad, José Nelson Amaral, Petr Tuma, Alexandru Iosup.
Methodological Principles for Reproducible Performance Evaluation in Cloud Computing. IEEE Trans. Software Eng., volume 47, pp. 1528-1543. 2021.
DOI: 10.1109/TSE.2019.2927908
Alexandru Uta, Alexandru Custura, Dmitry Duplyakin, Ivo Jimenez, Jan S. Rellermeyer, Carlos Maltzahn, Robert Ricci, Alexandru Iosup.
Is Big Data Performance Reproducible in Modern Cloud Networks?. 17th USENIX Symposium on Networked Systems Design and Implementation, NSDI, Santa Clara, CA, USA, February 25-27, pp. 513-527. 2020.

Laurens Versluis, Roland Mathá, Sacheendra Talluri, Tim Hegeman, Radu Prodan, Ewa Deelman, Alexandru Iosup.
The Workflow Trace Archive: Open-Access Data From Public and Private Computing Infrastructures. IEEE Trans. Parallel Distributed Syst., volume 31, pp. 2170-2184. 2020.
DOI: 10.1109/TPDS.2020.2984821

Storage

Sacheendra Talluri, Alicja Luszczak, Cristina L. Abad, Alexandru Iosup.
Characterization of a Big Data Storage Workload in the Cloud. Proceedings of the ACM/SPEC International Conference on Performance Engineering, ICPE, Mumbai, India, April 7-11, pp. 33-44. 2019.
DOI: 10.1145/3297663.3310302