Important Links
- RG Big Data Working Group
- RG Cloud Working Group
- RG DevOps Performance Working Group
- RG Security Benchmarking Working Group
- RG Power Working Group
- RG Quality of Experience Working Group
- Latest Newsletter Issue
- ICPE International Conference
- RG Zenodo Artefact Repository
Upcoming Events
- ICPE 2019, Mumbai, India
April 7-11, 2019
Index
- Introduction
- Keynote Talk
Session Chair: Klaus Lange (Hewlett Packard)- Software Knows Best: Portable Parallelism Requires Standardized Measurements of Transparent Hardware (Page 1)
David A. Patterson (University of California, Berkeley)
- Software Knows Best: Portable Parallelism Requires Standardized Measurements of Transparent Hardware (Page 1)
- Invited Talk
Session Chair: Samuel Kounev (University of Karlsruhe)- BAP: A Benchmark-driven Algebraic Method for the Performance Engineering of Customized Services (Page 3)
Jerry Rolia (Hewlett Packard Laboratories)
Diwkar Krishnamurthy (University of Calgary)
Giuliano Casale (SAP Research, Belfast)
Stephen Dawson (SAP Research, Belfast)
- BAP: A Benchmark-driven Algebraic Method for the Performance Engineering of Customized Services (Page 3)
- Session 1: Model Driven Performance and Development
Session Chair: Connie U. Smith (Performance Engineering Services- Modeling and Simulating Flash Based Solid-State Disks for Operating Systems (Page 15)
Kaoutar El Maghraoui (IBM T.J. Watson Research Center)
Gokul Kandiraju (IBM T.J. Watson Research Center)
Joefon Jann (IBM T.J. Watson Research Center)
Pratap Pattnaik (IBM T.J. Watson Research Center) - A Framework for Utility-Based Service Oriented Design in SASSY (Page 27)
Daniel A. Menascé (George Mason University)
John M. Ewing (George Mason University)
Hassan Gomaa (George Mason University)
Sam Malek (George Mason University)
João P. Sousa (George Mason University) - State Dependence in Performance Evaluation of Component-Based Software Systems (Page 37)
Lucia Kapova (University Karlsruhe)
Babora Buhnova (Masaryk University)
Anne Martens (University Karlsruhe)
Jens Happe (Forschungszentrum Informatik (FZI))
Ralf Reussner (University Karlsruhe & Forschungszentrum Informatik) - Performance Aware Open-world Software in a 3-Layer Architecture (Page 49)
Diego Perez-Palacin (Universidad de Zaragoza)
José Merseguer (Universidad de Zaragoza)
Simona Bernardi (Università di Torino)
- Modeling and Simulating Flash Based Solid-State Disks for Operating Systems (Page 15)
- Session 2a: Performance Measurements, Analysis and Tools I
Session Chair: Kai Sachs (TU Darmstadt)- Rapid Development of Extensible Profilers for the Java Virtual Machine with Aspect-Oriented Programming (Page 57)
Danilo Ansaloni (University of Lugano)
Walter Binder (University of Lugano)
Alex Villazón (University of Lugano)
Philippe Moret (University of Lugano) - Exploring Large Profiles with Calling Context Ring Charts (Page 63)
Philippe Moret (University of Lugano)
Walter Binder (University of Lugano)
Alex Villazón (University of Lugano)
Danilo Ansaloni (University of Lugano)
- Rapid Development of Extensible Profilers for the Java Virtual Machine with Aspect-Oriented Programming (Page 57)
- Session 2b: Performance Measurements, Analysis and Tools II
Session Chair: Kalyan Kumaran (Argonne National Laboratory)- Analytical Modeling of Lock-based Concurrency Control with Arbitrary Transaction Data Access Patterns (Page 69)
Pierangelo Di Sanzo (Università di Roma)
Roberto Palmieri (Università di Roma)
Bruno Ciciani (Università di Roma)
Francesco Quaglia (Università di Roma)
Paolo Romano (INESC-ID) - MPInside: A Performance Analysis and Diagnostic Tool for MPI Applications (Page 79)
Daniel Thomas (SGI)
Jean-Pierre Panziera (SGI)
John Baron (SGI) - Workload-Intensity-Sensitive Timing Behavior Analysis for Distributed Multi-User Software Systems (Page 87)
Matthias Rohr (BTC Business Technology Consulting AG & University of Oldenburg)
André van Hoorn (University of Oldenburg)
Wilhelm Hasselbring (University of Oldenburg & University of Kiel)
Marco Lübcke (CeWe Color AG & Co. OHG)
Sergej Alekseev (Nokia Siemens Networks & University of Applied Sciences)
- Analytical Modeling of Lock-based Concurrency Control with Arbitrary Transaction Data Access Patterns (Page 69)
- Session 3: Performance and other Quality Aspects and Domains
Session Chair: Jerry Rolia (Hewlett Packard Laboratories)- Monitoring for Security Intrusion using Performance Signatures (Page 93)
Alberto Avritzer (Siemens Corporate Research)
Rajanikanth Tanikella (Siemens Corporate Research)
Kiran James (Siemens Corporate Research)
Robert G. Cole (JHU/Applied Physics Laboratory)
Elaine Weyuker (AT&T Labs - Research) - Automatically Improve Software Architecture Models for Performance, Reliability, and Cost Using Evolutionary Algorithms (Page 105)
Anne Martens (Siemens Corporate Research)
Rajanikanth Tanikella (Siemens Corporate Research)
Kiran James (Siemens Corporate Research)
Robert G. Cole (JHU/Applied Physics Laboratory)
Elaine Weyuker (AT&T Labs - Research) - SLA-driven Planning and Optimization of Enterprise Applications (Page 117)
Hui Li (SAP Research Karlsruhe)
Giuliano Casale (SAP Research Belfast)
Tariq Ellahi (SAP Research Belfast) - Agile Resource Management in a Virtualized Data Center (Page 129)
Wei Zhang (Worcester Polytechnic Institute)
Hangwei Qian (Case Western Reserve University)
Craig E. Wills (Worcester Polytechnic Institute)
Michael Rabinovich (Case Western Reserve University)
- Monitoring for Security Intrusion using Performance Signatures (Page 93)
- Session 4: Benchmarking 1
Session Chair: David Kaeli (Northeastern University)- Experimental Study of Protocol-independent Redundancy Elimination Algorithms (Page 141)
Maxim Martynov (Cisco Systems) - A Power Consumption Analysis of Decision Support Systems (Page 147)
Meikel Poess (Oracle Corporation)
Raghunath Othayoth Nambiar (Hewlett-Packard Company) - Black-box Performance Models for Virtualized Web Service Applications (Page 153)
Danilo Ardagna (Politecnico di Milano)
Mara Tanelli (Politecnico di Milano)
Marco Lovera (Politecnico di Milano)
- Experimental Study of Protocol-independent Redundancy Elimination Algorithms (Page 141)
- Session 5: Modelling and Tools and Methodologies
Session Chair: John Henning (Sun Microsystems)- A General Result for Deriving Product-Form Solutions in Markovian Models (Page 165)
Andrea Marin (Università Cá Foscari di Venezia)
Maria Grazia Vigliotti (Imperial College London) - A Markovian Futures Market for Computing Power (Page 177)
Fernando Martínez Ortuno (Imperial College London)
Uli Harder (Imperial College London)
Peter G. Harrison (Imperial College London) - Relating Layered Queueing Networks and Process Algebra Models (Page 183)
Mirco Tribastone (The University of Edinburgh) - Synthesising PEPA Nets from IODs for Performance Analysis (Page 195)
Juliana Bowles (University of St-Andrews)
Leila Kloul (University of St-Andrews) - A Page Fault Equation for Dynamic Heap Sizing (Page 201)
Y. C. Tay (National University of Singapore)
X. R. Zong (Duke University)
- A General Result for Deriving Product-Form Solutions in Markovian Models (Page 165)
- Session 6: Benchmarking 2
Session Chair: Alberto Avritzer (Siemens Corporate Research)- Resource Demand Modeling for Multi-Tier Services (Page 207)
Jerry Rolia (Hewlett Packard Laboratories)
Amir Kalbasi (University of Calgary)
Diwakar Krishnamurthy (University of Calgary)
Stephen Dawson (SAP Research) - Addressing the Stranded Power Problem in Datacenters using Storage Workload Characterization (Page 217)
Sriram Sankar (Microsoft Corporation)
Kushagra Vaid (Microsoft Corporation) - Reducing Performance Non-determinism via Cache-aware Page Allocation Strategies (Page 223)
Michal Hocko (Charles University)
Michal Hocko (Charles University & Purdue University) - Quantifying Load Imbalance on Virtualized Enterprise Servers (Page 235)
Emmanuel Arzuaga (Northeastern University)
David R. Kaeli (Northeastern University)
- Resource Demand Modeling for Multi-Tier Services (Page 207)
- Poster Session
- Phymss - Performance Hybrid Model Solver and Simulator Based on UML MARTE Diagrams (Page 243)
Cosmina Chişe (University of Timisoara)
Ioan Jurca (University of Timisoara) - Towards the Identification of "Guilty" Performance Antipatterns (Page 245)
Vittorio Cortellessa (Università degli Studi dell-Aquila)
Anne Martens (Karlsruhe Institute of Technology)
Ralf Reussner (Karlsruhe Institute of Technology)
Catia Trubiani (Università degli Studi dell'Aquila) - On the Efficacy of Call Graph-Level Thread-Level Speculation (Page 247)
Arun Kejariwal (Yahoo! Inc.)
Milind Girkar (Intel Corporation)
Xinmin Tian (Intel Corporation)
Hideki Saito (Intel Corporation)
Alexandru Nicolau (University of California at Irvine)
Alexander V. Veidenbaum (University of California at Irvine)
Utpal Banerjee (University of California at Irvine)
Constantine D. Polychronopoulos (University of Illinois at Urbana-Champaign) - Semantic Layered Architecture to Integrate FR/NFR in Software Performance Engineering (Page 249)
Isaac Lera (University of the Balearic Islands)
Ramon Puigjaner (University of the Balearic Islands) - Automatable & Scalable Late Cycle Performance Analysis (Page 251)
Florian Mangold (Universität München)
Moritz Hammer (Universität München)
Harald Roelle (Siemens AG) - Assessing Identity and Access Management Systems Based on Domain-Specific Performance Evaluation (Page 253)
Frank Schell (Karlsruhe Institute of Technology)
Andreas Schaf (Karlsruhe Institute of Technology)
Jochen Dinger (Karlsruhe Institute of Technology)
Hannes Hartenstein (Karlsruhe Institute of Technology) - PMIF Extensions: Increasing the Scope of Supported Models (Page 255)
Connie U. Smith (Performance Engineering Services)
Catalina M. Lladó (Universitat de les Illes Balears)
Ramon Puigjaner (Universitat de les Illes Balears)
- Phymss - Performance Hybrid Model Solver and Simulator Based on UML MARTE Diagrams (Page 243)
- Tutorials
- The Palladio Component Model (Page 257)
Steffen Becker (Forschungszentrum Informatik) - Benchmarking Event Processing Systems: Current State and Future Directions (Page 259)
Marcelo R. N. Mendes (University of Coimbra)
Pedro Bizarro (University of Coimbra)
Paulo Marques (University of Coimbra) - Regression Techniques for Performance Parameter Estimation (Page 261)
Murray Woodside (Carleton University) - Automatic Generation of Benchmark and Test Workloads (Page 263)
Jozo Dujmović (San Francisco State University)
- The Palladio Component Model (Page 257)
Keynote Talk
Session Chair: Klaus Lange (Hewlett Packard)
Software Knows Best: Portable Parallelism Requires Standardized Measurements of Transparent Hardware
Authors:
David A. Patterson (University of California, Berkeley)
Abstract:
The hardware trend of the last 15 years of dynamically trying to improve performance with little software visibility is not only irrelevant today, its counterproductive; adaptivity must be at the software level if parallel software is going to be portable, fast, and energy-efficient. A portable parallel program is an oxymoron today; there is no reason to be parallel if it's slow, and parallel can't be fast if it's portable. Hence, portable parallel programs of the future must be able to understand and measure /any/ computer on which it runs so that it can adapt effectively, which suggests that hardware measurement should be standardized and processor performance and energy consumption should become transparent.
In addition to software-controlled adaptivity for execution efficiency by using techniques like autotuning and dynamic scheduling, modern software environments adapt to improve /programmer/ efficiency [1]. Classic examples include dynamic linking, dynamic memory allocation, garbage collection, interpreters, just-in-time compilers, and debugger-support. Examples that are more recent are selective embedded just in time specialization (SEJITS) [2] for highly productive languages like Python and Ruby. Thus, the future of programming is likely to involve program generators at many levels of the hierarchy tailoring the application to the machine. These productivity advances via adaptivity should be reflected in modern benchmarks: virtually no one writes the statically linked, highest-level-optimized C programs that are the foundation of most benchmark suites.
The dream is to improve productivity without sacrificing too much performance. Indeed, how often have you heard the claim that a new productive environment is now "almost as fast as C" or "almost as fast as Java?" The implication of the necessary tie between productivity and performance in the manycore era is that these modern environments must be able to utilize manycore well, or the gap between highly efficient code and highly productive code will grow with the number of cores.
For industry's bet on manycore to win, therefore, both very high level and very low level programming environments will need to be able to understand and measure their underlying hardware and adapt their execution so as to be portable, relatively fast, and energy-efficient.
Hence, we argue that a standard of accurate hardware operation trackers (SHOT) would have a huge positive impact on making parallel software portable with good performance and energy efficiency, similar to the impact of the IEEE-754 standard had on portability of numerical software. In particular, we believe SHOT will lead to much larger improvements in portability, performance, energy efficiency of parallel codes than recent architectural fads like opportunistic "turbo modes," transactional memory, or reconfigurable computing.
Full text: Pdf
Invited Talk
Session Chair: Samuel Kounev (University of Karlsruhe)
BAP: A Benchmark-driven Algebraic Method for the Performance Engineering of Customized Services
Authors:
Jerry Rolia (Hewlett Packard Laboratories)
Diwkar Krishnamurthy (University of Calgary)
Giuliano Casale (SAP Research, Belfast)
Stephen Dawson (SAP Research, Belfast)
Abstract:
This paper describes our joint research on performance engineering methods for services in shared resource utilities. The techniques support the automated sizing of a customized service instance and the automated creation of performance validation tests for the instance. The performance tests permit fine-grained control over inter-arrival time and service time burstiness to validate sizing and facilitate the development and validation of adaptation policies. Our novel research on sizing also takes into account the impact of workload factors that contribute to such burstiness. The methods are automated, integrated, and exploit an algebraic approach to workload modelling that relies on per-service benchmark suites with benchmarks that can be automatically executed within utilities. The benchmarks and their performance results are reused to support a Benchmark-driven Algebraic method for the Performance (BAP) engineering of customized services.
Full text: PDF