Sunday, 24 June 2018

Mission Statement

The mission of the IDS Benchmarking Working Group of SPEC Research is to foster and facilitate innovative research in computer system and network intrusion detection, with special attention given to benchmarking intrusion detection systems in virtualized cloud environments, through exchange of ideas and experiences, and dissemination of novel methods, techniques and tools for quantitative evaluation and analysis of intrusion detection systems.

General Topics of Interest

Topics of interest include, but are not limited to, the following:

  • Security- and performance-related IDS benchmarking metrics
  • Workloads based on vulnerability and attack injection
  • IDS benchmarking methodologies
  • IDS benchmarking methods with respect to features and properties of cloud platforms
  • Performance attack signatures


  • Analysis of existing IDS benchmarking efforts
  • Identification of relevant challenges and requirements for benchmarking intrusion detection systems
  • Development of IDS benchmarking methodologies
  • Analysis and development of IDS benchmarking metrics
  • Design and development of IDS benchmarking framework