News and Press Releases
Wrapping Up ICPE 2024: A Milestone Event in Performance Engineering
We are delighted to share insights and highlights from the recently concluded ICPE 2024, held May 7-11th in London.
More ...
Call-for-Nominations: SPEC Kaivalya Dixit Distinguished Dissertation Award 2024
SPEC Kaivalya Dixit Distinguished Dissertation Award is open to dissertations that have been defended between October 2022 and September 2024.
More ...
Keynote on "Serverless Computing: An Old Wine in New Bottles or More?" at CCGRID 2024
A Keynote by Sam Kounev on "Serverless Computing: An Old Wine in New Bottles or More?" summarizing the results from multiple collaborations under the umbrella of SPEC RG was presented at the 24th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGRID 2024) in Philadelphia on May 8, 2024.
More ...
New SPEC RG Newsletter Issue Available
This regular publication will provide you with information on latest developments, news and announcements relevant to the benchmarking and quantitative system evaluation communities.
More ...
Winner of SPEC Kaivalya Dixit Distinguished Dissertation Award 2023
Shreshth Tuli from Imperial College London: AI and Co-Simulation Driven Resource Management in Fog Computing Environments
More ...
Research Group Steering Committee Elections
The latest annual elections to the SPEC RG Steering Committee were performed in March 2023. Subject to the elections were the Class B seats and the Officer positions.
More ...
14th ACM/SPEC ICPE 2023 back from virtual to real world in Coimbra, Portugal
With a crowd of 150+ participants, the 14th edition of the ACM/SPEC International Conference on Performance Engineering (ICPE 2023) took place in the city of Coimbra, Portugal on April 15-19
More ...
New SPEC RG Newsletter Issue Available
This regular publication will provide you with information on latest developments, news and announcements relevant to the benchmarking and quantitative system evaluation communities.
More ...
Call-for-Nominations: SPEC Kaivalya Dixit Distinguished Dissertation Award 2023
SPEC Kaivalya Dixit Distinguished Dissertation Award is open to dissertations that have been defended between October 2021 and September 2023.
More ...
Winners of the SPEC Achievement Awards 2023
This year recipients of the SPEC SPECtacular and Impact Awards
More ...
Winner of SPEC Kaivalya Dixit Distinguished Dissertation Award 2022
Lishan Yang, the College of William & Mary (US): Practical GPGPU Application Resilience Estimation and Fortification
More ...
Call-for-Nominations: SPEC Kaivalya Dixit Distinguished Dissertation Award 2022
SPEC Kaivalya Dixit Distinguished Dissertation Award is open to dissertations that have been defended between October 2021 and September 2022.
More ...
Virtual ACM/SPEC ICPE 2022 with more than 370 registrations
Over 370 registrations from industry and academia: the 13th ACM/SPEC ICPE 2022 was held virtually
More ...
Research Group Steering Committee Elections
The RGSC elections were finalized on April 6, 2022
More ...
New SPEC RG Newsletter Issue Available
This regular publication will provide you with information on latest developments, news and announcements relevant to the benchmarking and quantitative system evaluation communities.
More ...
Winner of SPEC Kaivalya Dixit Distinguished Dissertation Award 2021
André Bauer from University of Würzburg: Automated Hybrid Time Series Forecasting: Design, Benchmarking, and Use Cases
More ...
Winners of the SPEC Achievement Awards 2022
This year recipients of the SPEC Presidential, SPECtacular, and Contributor Awards
More ...
Registration opened (free) for ICPE 2022, conference included in CORE 2021 ranking
Conference program is already available online.
More ...
Call-for-Nominations: SPEC Kaivalya Dixit Distinguished Dissertation Award 2021
SPEC Kaivalya Dixit Distinguished Dissertation Award is open to dissertations that have been defended between October 2020 and September 2021.
More ...
New Textbook on Systems Benchmarking
A new textbook on the topic of systems benchmarking written by SPEC RG Members was published by Springer International Publishing.
More ...
Winner of SPEC Kaivalya Dixit Distinguished Dissertation Award 2020
Maher Alharby from Newcastle University: Models and Simulation of Blockchain Systems
More ...
New Tool Accepted
Mowgli: evaluation framework for cloud-hosted DBMS
More ...
The Article "Serverless Applications: Why, When, and How?" from the SPEC RG Cloud Working Group was accepted at IEEE Software
In an ongoing activitiy, the SPEC RG Cloud Working Group collected and characterized 89 serverless applications. An article that based on this dataset explores why, when and how practictioners build serverless applications has been accepted at IEEE Software.
More ...
Call-for-Nominations: SPEC Kaivalya Dixit Distinguished Dissertation Award 2020
The award is open to dissertations that have been defended between October 2019 and September 2020. The submission deadline is September 30, 2020.
More ...
Technical Report on "A Review of Serverless Use Cases and their Characteristics" Published
The SPEC RG Cloud Working Group has published a Technical Report on "A Review of Serverless Use Cases and their Characteristics"
More ...
Virtual ACM/SPEC ICPE 2020 attended by over 500 participants
Over 500 participants from industry and academia attended the 11th ACM/SPEC ICPE 2020 held virtually.
More ...
Winner of SPEC Kaivalya Dixit Distinguished Dissertation Award 2019
Guanpeng Li from University of British Columbia: Understanding and modeling error propagation in programs
More ...
New Tool Accepted
LibReDE: a library for resource demand estimation
More ...
New Tool Accepted
TeaStore: a micro-service reference and test application for scientific and industrial benchmarks and tests.
More ...
Call-for-Nominations: SPEC Kaivalya Dixit Distinguished Dissertation Award 2019
The award is open to dissertations that have been defended between October 2018 and September 2019. The submission deadline is September 30, 2019.
More ...
RG Elections Completed
The elections of RG Officers and Steering Committee were completed on April 23, 2019
More ...
ACM/SPEC ICPE 2019 attended by over 210 participants
Over 210 participants from industry and academia attended the 10th ACM/SPEC ICPE 2019 in Mumbai, India
More ...
Technical Report on "Reproducible Performance Evaluation in Cloud Computing" Published
The SPEC RG Cloud Working Group has published a Technical Report on "Methodological Principles for Reproducible Performance Evaluation in Cloud Computing"
More ...
New SPEC RG Newsletter Issue Available
This regular publication will provide you with information on latest developments, news and announcements relevant to the benchmarking and quantitative system evaluation communities.
More ...
HotCloudPerf 2019
The Call for Papers for the 2nd Workshop on Hot Topics in Cloud Computing Performance (HotCloudPerf 2019) is online.
More ...
SPEC Kaivalya Dixit Distinguished Dissertation Award 2018 Winners
The Kaivalya Dixit Distinguished Dissertation Selection committee has chosen this year to select two winners based on the high quality of both submissions.
More ...
ACM/SPEC ICPE 2018 attended by over 170 participants
Over 170 participants from industry and academia attended the 9th ACM/SPEC ICPE 2018 in Berlin, Germany
More ...
Call for Contributions: 10th ACM/SPEC International Conference on Performance Engineering (ICPE 2019)
The conference will be held in Mumbai, India on April 7-11, 2019. This year's main theme is "performance engineering in the Artificial Intelligence era."
More ...
Call-for-Nominations: SPEC Kaivalya Dixit Distinguished Dissertation Award 2018
The award is open to dissertations that have been defended between October 2017 and September 2018. The submission deadline is September 30, 2018.
More ...
RG Elections Completed
The elections of RG Officers and Steering Committee were completed on May 2nd, 2018
More ...
Conference Announcement: 15th International Conference on Managed Languages & Runtimes
ManLang '18 will be held in Linz, Austria on September 10-14, 2018.
More ...
SPEC Kaivalya Dixit Distinguished Dissertation Award 2017 Winner and Runner Up
The Selection committee has chosen this year to select two this year; a winner and a runner up based on the high quality of both submissions.
More ...
HotCloudPerf 2018
The Call for Papers for the 1st Workshop on Hot Topics in Cloud Computing Performance (HotCloudPerf 2018) is online.
More ...
QUDOS 2018
The Call for Papers for the 4th International Workshop on Quality-aware DevOps (QUDOS 2018) is online.
More ...
SPEC RG Face-to-Face Meeting 2017
The seventh SPEC RG Face-to-Face Meeting took place on April 26, 2017 at the ICPE 2017 conference in l'Aquila, Italy.
More ...
ICPE 2017 attended by over 140 participants
Over 140 participants from industry and academia attended the 8th ACM/SPEC ICPE 2017 in l'Aquila, Italy.
More ...
Call-for-Participation: 14th IEEE International Conference on Autonomic Computing
ICAC 2017 will be held in Columbus, Ohio, USA on July 17-21, 2017.
More ...
Best Demo/Poster Award for RG Power Tool @ ICPE 2017
The demonstration of the Autopilot tool by the SPEC RG Power Working Group was recognized by the best demo/poster award at the International Conference on Performance Engineering 2017.
More ...
Call-for-Nominations: SPEC Kaivalya Dixit Distinguished Dissertation Award 2017
The award is open to dissertations that have been defended between October 2016 and September 2017. The submission deadline is September 30, 2017.
More ...
RG Elections Completed
The elections of RG Officers and Steering Committee were completed on April 26th, 2017
More ...
Call-for-Contributions: 14th IEEE International Conference on Autonomic Computing
ICAC 2017 has issued a call for contributions. The conference will be held in Columbus, Ohio, USA on July 17-21, 2017.
More ...
Winner of SPEC Kaivalya Dixit Distinguished Dissertation Award 2016
Scott Beamer from University of California, Berkeley: Understanding and Improving Graph Algorithm Performance
More ...
On November 7th, the Computer Measurement Group (CMG)https://www.cmg.org/2016-a-a-michelson-award-announcement/
More ...
QUDOS @ ICPE 2017
The Call for Papers for the 3rd International Workshop on Quality-aware DevOps (QUDOS 2017) is online.
More ...
Survey on Performance-aware DevOps Launched By SPEC RG
This survey is part of a larger project aiming on building best-practice infrastructures for Performance-aware DevOps.
More ...
Over 120 Attendees at ICPE 2016
Participants from industry and academia attended ICPE 2016 in Delft, the Netherlands. One best research paper and one best industry paper were awarded.
More ...
Call-for-Nominations: SPEC Kaivalya Dixit Distinguished Dissertation Award 2016
The award is open to dissertations that have been defended between October 1, 2015 and September 30, 2016. The submission deadline is September 30, 2016.
More ...
New Tool Accepted: inspectIT
An open source application performance management solution
More ...
New Tool Accepted: LIKWID
A set of command line tools and a library for the Linux operating system covering hardware performance profiling, system information/configuration and microbenchmarking.
More ...
RG Elections Completed
The elections of RG Officers and Steering Committee were completed on April 28th, 2016.
More ...
New SPEC RG Newsletter Issue Available
This regular publication will provide you with information on latest developments, news and announcements relevant to the benchmarking and quantitative system evaluation communities.
More ...
SPEC RG Face-to-Face Meeting 2016
The sixth SPEC RG Face-to-Face Meeting took place on March 16, 2016 at the ICPE 2016 conference in Delft, the Netherlands.
More ...
QUDOS @ ISSTA 2016
The Call for Papers for the 2nd International Workshop on Quality-aware DevOps (QUDOS 2016) is online.
More ...
Technical Report on Cloud Metrics Published
The SPEC RG Cloud Working Group has published a Technical Report on cloud metrics.
More ...
New Tool Accepted: DynamicSpotter
DynamicSpotter is a framework for measurement-based, automatic detection of software performance problems in Java-based enterprise software systems.
More ...
Winner of the SPEC Distinguished Dissertation Award 2015
Yufei Ren from Stony Brook University, New York - wins the 2015 SPEC Distinguished Dissertation Award.
More ...
Call-for-Contributions: 13th IEEE International Conference on Autonomic Computing
ICAC 2016 has issued a call for contributions. The conference will be held in Wuerzburg, Germany on July 19-22, 2016.
More ...
Technical Report on Performance-oriented DevOps Published
The SPEC RG DevOps Performance Working Group has published a Technical Report on a research agenda for performance-oriented DevOps.
More ...
Article accepted for publication in the prestigious journal "ACM Computing Surveys"
A paper by the SPEC RG IDS Benchmarking Working Group has been accepted for publication in ACM Computing Surveys (CSUR). The paper surveys the state-of-the-art in the area of evaluation of intrusion detection systems.
More ...
Call-for-Nominations: SPEC Distinguished Dissertation Award 2015
The SPEC Distinguished Dissertation Award is open to dissertations defended between October 1, 2014, and September 30, 2015. The submission deadline is September 30, 2015.
More ...
New Tool Accepted: LIMBO
LIMBO is an Eclipse-based tool for handling and instantiating load intensity models.
More ...
RG Elections Completed
The elections of RG Officers and Steering Committee were completed on April 10, 2015.
More ...
QUDOS @ ESEC/FSE 2015
The Call for Papers for the 1st International Workshop on Quality-aware DevOps (QUDOS 2015) is online.
More ...
New SPEC RG Newsletter Issue Available
This regular publication will provide you with information on latest developments, news and announcements relevant to the benchmarking and quantitative system evaluation communities.
More ...
Winner of the SPEC Distinguished Dissertation Award 2014
Nadav Amit from Technion - Israel Institute of Technology wins the 2014 SPEC Distinguished Dissertation Award.
More ...
Big Data Working Group Launched
The newly formed working group is a continuation of the Big Data Benchmarking Community under the SPEC Research umbrella
More ...
DevOps Performance Working Group Launched
The newly formed working group is concerned with combining application performance management (APM) and software performance engineering (SPE) activities for business-critical application systems
More ...
Call-for-Participation: QEST 2014
The 11th International Conference on Quantitative Evaluation of SysTems (QEST 2014) technically co-sponsored by SPEC RG is held in Florence, Italiy from Sep 8 to Sep 10, 2014.
More ...
Call-for-Nominations: SPEC Distinguished Dissertation Award 2014
The SPEC Distinguished Dissertation Award is open to dissertations defended between October 1, 2013, and September 30, 2014. The submission deadline is September 30, 2014.
More ...
ACM/SPEC International Conference Issues Call for Contributions on Performance Engineering
The Call for Contributions for the 6th ACM/SPEC International Conference on Performance Engineering (ICPE 2015) is now online.
More ...
Over 130 Attendees at ICPE 2014
Participants from industry and academia attended ICPE 2014 in Dublin, Ireland. RG members recognized as co-authors of best paper award.
More ...
SPEC RG Face-to-Face Meeting 2014
The fourth SPEC RG Face-to-Face Meeting took place on March 26-27, 2014 at the ICPE 2014 conference in Dublin, Ireland.
More ...
RG Elections Completed
The elections of RG Officers and Steering Committee were completed on April 7, 2014.
More ...
New Tool Accepted: SPA
SPA, a framework for performance evaluation tailored for storage systems, was accepted for the repository of tools for quantitative system evaluation and analysis.
More ...
New SPEC RG Newsletter Issue Available
This regular publication will provide you with information on latest developments, news and announcements relevant to the benchmarking and quantitative system evaluation communities.
More ...
Winner of the SPEC Distinguished Dissertation Award 2013
Anshul Gandhi from Carnegie Mellon University now at IBM T. J. Watson Research Center wins the 2013 SPEC Distinguished Dissertation Award.
More ...
New Tool Accepted: DiSL
DiSL, a Domain-Specific Language for Bytecode Instrumentation, was accepted for the repository of tools for quantitative system evaluation and analysis.
More ...
Technical Report on Benchmarking Intrusion Detection Systems in Virtualized Environments Published
The SPEC RG IDS Benchmarking Working Group has published a technical report on benchmarking intrusion detection systems (IDSes) in virtualized environments, i.e., VMM(Virtual Machine Monitor)-based IDSes.
More ...
SPEC RG Welcomes its Newest Members
The Research Group welcomes the 14 new member organizations that joined SPEC RG in the past six months. SPEC RG actively solicits new participants interested in the activities of the Research Group.
More ...
New SPEC RG Newsletter Issue Available
This regular publication will provide you with information on latest developments, news and announcements relevant to the benchmarking and quantitative system evaluation communities.
More ...
ACM/SPEC International Conference Issues Call for Papers on Performance Engineering
The Call-for-Papers for the 5th ACM/SPEC International Conference on Performance Engineering (ICPE 2014) is now online.
More ...
Talk on "Benchmarking Intrusion Detection Systems for Virtualized Environments at SPEC RG" at EWDC 2013
During the workshop opening session, Aleksandar Milenkoski, Secretary of the IDS Benchmarking Working Group, gave a talk on the research activities of the working group.
More ...
Technical Report on Cloud Usage Patterns Published
The SPEC RG Cloud Working Group has published a Technical Report on cloud usage patterns, a textual and visual formalism for describing common cloud usage scenarios.
More ...
Call-for-Nominations: SPEC Distinguished Dissertation Award 2013
The SPEC Distinguished Dissertation Award is open to dissertations defended between 2012-10-01 and 2013-09-30. The submission deadline is 2013-09-30.
More ...
Several SPEC RG Officers Recognized by SPEC President
RG Officers Alexandru Iosup, Qais Noorshams, Aleksandar Milenkoski were recognized by the SPEC President and the SPEC RG Chair for their outstanding service to SPEC in 2012.
More ...
SPEC RG Face-to-Face Meeting 2013
The third SPEC RG Face-to-Face Meeting took place on April 24-25, 2013 at the ICPE 2013 Conference in Prague, Czech Republic.
More ...
ICPE 2013 Best Industry Paper Award
Klaus Lange (HP) and Meikel Poess (Oracle) recognized as co-authors of the two best industry track papers at ICPE 2013.
More ...
Over 160 Attendees at ICPE 2013
Participants from industry and academia coming from 25 different countries attended ICPE 2013 in Prague, Czech Republic.
More ...
New Tool Accepted
The FINCoS Framework was accepted for the repository of tools for quantitative system evaluation and analysis.
More ...
RG Elections Completed
The elections of RG Officers and Steering Committee were completed on April 5, 2013.
More ...
Winner of the SPEC Distinguished Dissertation Award 2012
Shicong Meng from the Georgia Institute of Technology wins the 2012 SPEC Distinguished Dissertation Award
More ...
HotTopiCS 2013
The Call-for-Papers for the 2013 International Workshop on Hot Topics in Cloud Services (HotTopiCS) technically co-sponsored by SPEC RG is now online.
More ...
SPEC RG Member Receives Best Impact Award at SuperComputing'12
Alexandru Iosup (TU Delft) received the Best Impact Award of the MTAGS workshop at the prestigious ACM/IEEE conference on High Performance Computing and Networking (SC).
More ...
IDS Benchmarking Working Group Launched
The newly formed working group is concerned with quantitiative evaluation of intrusion detection systems, with special attention given to such systems in virtualized cloud environments.
More ...
SPEC RG Newsletter Launched
This regular publication will provide you with information on latest developments, news and announcements relevant to the benchmarking and quantitative system evaluation communities.
More ...
Call-for-Nominations: SPEC Distinguished Dissertation Award 2012
The SPEC Distinguished Dissertation Award is open to dissertations defended between 2011-10-01 and 2012-09-30. The submission deadline is 2012-09-30.
More ...
ICPE 2013 Call-for-Papers Online
The Call-for-Papers for the 4th ACM/SPEC International Conference on Performance Engineering (ICPE 2013) is now online.
More ...
Preliminary Announcement of ICPE 2013
The next ACM/SPEC International Conference on Performance Engineering (ICPE) will be held in Prague, Czech Republic in April 2013.
More ...
Over 100 Attendees at ICPE 2012
Participants from industry and academia coming from more than a dozen countries spread across four continents attended ICPE 2012 in Boston, USA.
More ...
SPEC RG Face-to-Face Meeting
The second SPEC RG Face-to-Face Meeting took place on April 26-27, 2012 at the ICPE 2012 Conference in Boston, USA.
More ...
SPEC Distinguished Dissertation Awards 2011
The first two SPEC Distinguished Dissertation Awards were presented by SPEC President Walter Bays at ICPE 2012 on April 25 in Boston, USA.
More ...
RG Elections Completed
The elections of RG Officers and Steering Committee were completed on April 5, 2012.
More ...
Call for Participation: ICPE 2012
A Joint Meeting of WOSP/SIPEW sponsored by ACM SIGMETRICS and ACM SIGSOFT in Cooperation with SPEC.
More ...
Call for Proposals to Host ICPE 2013 and ICPE 2014
The ICPE Steering Committee is soliciting proposals for location and organizers of the Spring 2013 and 2014 conferences.
More ...
Repository of Peer-Reviewed Tools Launched
SPEC RG opens a repository of peer-reviewed tools for quantitative system evaluation and analysis.
More ...
SPEC Distinguished Dissertation Awards 2011
Luk Van Ertvelde of Ghent University and Kai Sachs of TU Darmstadt first to win new SPEC Distinguished Dissertation Award.
More ...
ICPE 2012 Research Deadlines Extended
Abstract and paper submission deadlines for the research track are extended for 1 week.
More ...
ICPE 2012 Call-for-Papers Online
The Call-for-Papers for the 3rd ACM/SPEC International Conference on Performance Enginerering (ICPE 2012) is now online at http://icpe2012.ipd.kit.edu/. ICPE 2012 will take place on April 22-25 in Boston, USA. The submission deadlines can be found at http://icpe2012.ipd.kit.edu/important_dates/
More ...
New Poster and Flyer Available
New poster/flyer is now available summarizing the mission of SPEC's Research Group, its scope, goals and major ongoing activities. You can download the poster here.
More ...
Call-for-Nominations: SPEC Benchmarking Research PhD Award 2011
SPEC has established a Research Award to be presented to a PhD student whose thesis is regarded to be an exceptional, innovative contribution in the scope of SPEC's Research Group.
More ...
SPEC RG Face-to-Face Meeting
The first SPEC RG Face-to-Face Meeting took place on March 15-16, 2011 at the ICPE 2011 Conference in Karlsruhe, Germany.
More ...
Over 120 Attendees at ICPE 2011
Over 120 participants from industry and academia coming from 20 different countries attended ICPE 2011 in Karlsruhe.
More ...
Research Group of SPEC Publicly Announced
The Research Group of SPEC was publicly announced today. The official press release can be found at: www.spec.org/news/rgpressrelease.html
More ...