The programs that produce SAT benchmarks, each as a Docker image: the families the competitions used, and others that live outside them, in papers and in solver tuning.

A pilot, and a collective one: please check, correct and contribute. Everything here is generated from the data of the sat-heritage/benchs-generators repository. A generator whose licence is unknown has its recipe published but no image, and a family with no generator is one we could not find or could not run: corrections, missing generators and licence clarifications are welcome as pull requests or issues. Adding your own generator takes four files, or just an issue with a link to your code: see adding a generator. The companion project for solvers is SAT Heritage.
Overview · Families

cryptography-simon

Solver rankings on this family, and the generator that reproduces it.

What to run on a problem of this kind

The solvers that did best on this family in the SAT Competition 2024, as images of the companion project. They are a better bet on such a problem than the overall winner of that year, which this family often disagrees with.

SolverSolvedCommand
kissat-sc202410 / 10 
docker run --rm -v "$PWD:/data" satex/kissat-sc2024:2024 your-instance.cnf
Cadical_ESA10 / 10 
docker run --rm -v "$PWD:/data" satex/cadical-esa:2024 your-instance.cnf
CaDiCaL10 / 10 
docker run --rm -v "$PWD:/data" satex/cadical:2024 your-instance.cnf

No generator here yet

We have not packaged a generator for this family. If you wrote it, or know where its code lives, a issue is very welcome.

SAT Competition 2023 · 17 instances

Ranked by PAR-2 on this family alone. Winner of the whole main track that year: SBVA-sbva_cadical.

#SolverSolvedPAR-2 per instance
1Cadical_rel_1.5.3.Scavel 1 / 179700 s
2AMSAT_ 0 / 1710000 s
3BreakID-kissat-low.sh 0 / 1710000 s
4CaDiCaL_vivinst 0 / 1710000 s
5Cadical_ESA 0 / 1710000 s
6IsaSAT 0 / 1710000 s
7Kissat_Inc_ESA 0 / 1710000 s
8Kissat_MAB_Binary 0 / 1710000 s
9Kissat_MAB_Conflict 0 / 1710000 s
10Kissat_MAB_Conflict+ 0 / 1710000 s
11Kissat_MAB_DeepWalk+ 0 / 1710000 s
12Kissat_MAB_ESA 0 / 1710000 s

SAT Competition 2024 · 10 instances

Ranked by PAR-2 on this family alone. Winner of the whole main track that year: kissat-sc2024.

#SolverSolvedPAR-2 per instance
1kissat-sc2024 10 / 100 s
2Cadical_ESA 10 / 100 s
3CaDiCaL 10 / 100 s
4hCaD-bva 10 / 100 s
5hCaD-pbva 10 / 100 s
6BreakID-Kissat 10 / 10336 s
7Kissat_MAB-DC 8 / 102582 s
8Kissat_MAB_ESA 6 / 104450 s
9AMSAT 5 / 105133 s
10AMSAT_RGC 5 / 105134 s
11Kissat_MAB_Binary 5 / 105865 s
12IsaSAT 0 / 1010000 s