The programs that produce SAT benchmarks, each as a Docker image: the families the competitions used, and others that live outside them, in papers and in solver tuning.

A pilot, and a collective one: please check, correct and contribute. Everything here is generated from the data of the sat-heritage/benchs-generators repository. A generator whose licence is unknown has its recipe published but no image, and a family with no generator is one we could not find or could not run: corrections, missing generators and licence clarifications are welcome as pull requests or issues. Adding your own generator takes four files, or just an issue with a link to your code: see adding a generator. The companion project for solvers is SAT Heritage.
Overview · Families

scheduling

Solver rankings on this family, and the generator that reproduces it.

What to run on a problem of this kind

The solvers that did best on this family in the SAT Competition 2024, as images of the companion project. They are a better bet on such a problem than the overall winner of that year, which this family often disagrees with.

SolverSolvedCommand
AMSAT35 / 50
docker run --rm -v "$PWD:/data" satex/amsat:2024 your-instance.cnf
AMSAT_RGC34 / 50
docker run --rm -v "$PWD:/data" satex/amsat-rgc:2024 your-instance.cnf
Kissat_MAB-DC32 / 50
docker run --rm -v "$PWD:/data" satex/kissat-mab-dc:2024 your-instance.cnf

Generator: Round-robin tournament scheduling

rr-gen rr TEAMS ROUNDS | rr-gen mv TEAMS ROUNDS VENUES

20 of 20 instances of this family regenerated exactly. Details and commands.

SAT Competition 2024 · 50 instances

Ranked by PAR-2 on this family alone. Winner of the whole main track that year: kissat-sc2024.

#SolverSolvedPAR-2 per instance
1AMSAT 35 / 503578 s
2AMSAT_RGC 34 / 503707 s
3Kissat_MAB-DC 32 / 503961 s
4hKis-bva 32 / 503974 s
5Kissat_MAB_Binary 31 / 504086 s
6Kissat_MAB_ESA 31 / 504163 s
7kissat-sc2024 30 / 504235 s
8hCaD-bva 31 / 504381 s
9CaDiCaL 29 / 504448 s
10Cadical_ESA 29 / 504510 s
11BreakID-Kissat 29 / 504515 s
12hCaD-pbva 28 / 504909 s