Wednesday, 13 December 2017

Session 6: Performance Modeling of Software and Systems

An Industrial Case Study of Performance and Cost Design Space Exploration

Authors:

Thijmen de Gooijer (ABB Corporate Research)
Anton Jansen (ABB Corporate Research)
Heiko Koziolek (ABB Corporate Research)
Anne Koziolek (University of Zurich)

Abstract:

Determining the trade-off between performance and costs of a distributed software system is important as it enables fulfilling performance requirements in a cost-efficient way. The large amount of design alternatives for such systems often leads software architects to select a suboptimal solution, which may either waste resources or cannot cope with future workloads. Recently, several approaches have appeared to assist software architects with this design task. In this paper, we present a case study applying one of these approaches, i.e. PerOpteryx, to explore the design space of an existing industrial distributed software system from ABB. To facilitate the design exploration, we created a highly detailed performance and cost model, which was instrumental in determining a cost-efficient architecture solution using an evolutionary algorithm. The case study demonstrates the capabilities of various modern performance modeling tools and a design space exploration tool in an industrial setting, provides lessons learned, and helps other software architects in solving similar problems.

DOI: 10.1145/2188286.2188319

Full text: PDF

[#][]

Using Computer Simulation to Predict the Performance of Multithreaded Programs

Authors:

Alexander Tarvo (Brown University)
Steven P. Reiss (Brown University)

Abstract:

Predicting the performance of a computer program facilitates its efficient design, deployment, and problem detection. However, predicting performance of multithreaded programs is complicated by complex locking behavior and concurrent usage of computational resources. Existing performance models either require running the program in many different configurations or impose restrictions on the types of programs that can be modeled. This paper presents our approach towards building performance models that do not require vast amounts of training data. Our models are built using a combination of queuing networks and probabilistic call graphs. All necessary information is collected using static and dynamic analyses of a single run of the program. In our experiments these models were able to accurately predict performance of different types of multithreaded programs and detected those configurations that result in the programs' high performance.

DOI: 10.1145/2188286.2188320

Full text: PDF

[#][]

Parallel File System Measurement and Modeling Using Colored Petri Nets

Authors:

Hai Nguyen (University of Arkansas)
Amy Apon (Clemson University)

Abstract:

Parallel file systems are significant challenges for high performance data-intensive system designers due to their complexity. Being able to study features and designs before building the actual system is an advantage that a simulation model can offer. This paper presents a detailed simulation-based performance model of the PVFS parallel file system. The model is developed using Colored Petri Nets. The goal of the simulation model is to provide a tool to examine end-to-end performance of a parallel file system and to build a foundation that can be easily expanded upon in the future to model many different types of parallel file systems. The performance evaluation results of the model demonstrate that the model performance behavior is close to the expected behavior of the real PVFS file system.

DOI: 10.1145/2188286.2188321

Full text: PDF

[#][]