The TTC 2025 UVL to Dot Benchmark

Case description

The docs/UVL_to_Dot_TTC_2025_Live_Contest.pdf file contains the case description.

Prerequisites

• 64-bit operating system
• Python 2.7 or higher
• R

Solution Prerequisites

• NMF: You need to install the .NET 9 SDK
• MontiCore: You need to install Gradle + Java 11 (other versions might work)

Add your prerequisites here!

Using the framework

The scripts directory contains the run.py script which is used for the following purposes:

• run.py -b -- builds the projects
• run.py -b -s -- builds the projects without testing
• run.py -m -- runs the benchmark
• run.py -v -- visualizes the results of the latest benchmark

The config directory contains the configuration for the scripts:

• config.json -- configuration for the model generation and the benchmark

Running the benchmark

The script runs the benchmark for the given number of runs, for the specified tools and change sequences.

The benchmark results are stored in a CSV file. The header for the CSV file is stored in the output/header.csv file.

Reporting and visualization

The benchmark script automatically analyses the numbers generated by the solutions and generates diagrams using MathPlotLib in Python.

Implementing the benchmark for a new tool

To implement a tool, you need to create a new directory in the solutions directory and give it a suitable name.