The benchmark tool provides a set of utilities to simplify the generation, execution, and evaluation of benchmarks. It currently supports:

  • Setting up the benchmarking environment
  • Creating benchmark execution scripts from XML specifications
  • Scheduling jobs on a cluster while respecting queue limits
  • Detecting basic errors during benchmark execution
  • Collecting benchmark results into a single XML file
  • Converting result XML files into XLSX spreadsheets and performing post-processing (summaries and plots)

Documentation

Resources