The programs that produce SAT benchmarks, each as a Docker image: the families the competitions used, and others that live outside them, in papers and in solver tuning.

A pilot, and a collective one: please check, correct and contribute. Everything here is generated from the data of the sat-heritage/benchs-generators repository. A generator whose licence is unknown has its recipe published but no image, and a family with no generator is one we could not find or could not run: corrections, missing generators and licence clarifications are welcome as pull requests or issues. Adding your own generator takes four files, or just an issue with a link to your code: see adding a generator. The companion project for solvers is SAT Heritage.
Overview · Generators

mdp-benchmark

mdp-gen -n BITS -t THRESHOLD -s SEED

What it is

Authors
Randal E. Bryant
Source of the author list
repository rebryant/mdp-benchmark and the SAT Competition 2022 benchmark description
Language
Python
Licence
MIT
Competitions
SAT Competition 2022
Repository
https://github.com/rebryant/mdp-benchmark.git
Pinned commit
9d7199acc6ae7cedb9f9581c5a0a147351228a84
Pinned git tree
61abbdd6b0cde3f001040e8f2e9a4e9ff3614977
Seed
-s; the repository ships src/generate.sh, the script that produced the submitted instances

Build it and run it

docker build -t satex-gen/mdp:2022 cnf/mdp
docker run --rm satex-gen/mdp:2022 ...  > instance.cnf

The image can be published: the licence allows it.

What it can produce

A generator is not limited to the instances a competition happened to keep: these are sample runs across its parameters, measured on the built image. Each command was run twice, to see whether it gives the same formula every time.

SampleCommand argumentsVariablesClauses
28 bits, satisfiable-n 28 -t 7 -s 1 8034,478
36 bits, satisfiable-n 36 -t 9 -s 1 1,2977,362
44 bits, satisfiable-n 44 -t 11 -s 1 1,91811,046

Reference instances

1 with the no match · 28 with the same GBD hash · 1 with the same number of variables and clauses. Each line regenerates one known instance, from a competition or from the set its author published; the level says how close the result is. See verification.

InstanceFamilyCommand argumentsGBD hashLevel
mdp-28-10-sat.cnfminimum-disagreement-parity -n 28 -t 7 -s 10 5457c05649be… 9 kB N1
mdp-28-10-unsat.cnfminimum-disagreement-parity -n 28 -t 6 -s 10 3184e52e950a… 9 kB N1
mdp-28-11-sat.cnfminimum-disagreement-parity -n 28 -t 7 -s 11 d1940d3d830e… 9 kB N1
mdp-28-11-unsat.cnfminimum-disagreement-parity -n 28 -t 6 -s 11 26f8332e50a4… 9 kB N1
mdp-28-12-sat.cnfminimum-disagreement-parity -n 28 -t 7 -s 12 cd36b290c27e… 10 kB N1
mdp-28-12-unsat.cnfminimum-disagreement-parity -n 28 -t 6 -s 12 c221c5dc006d… 9 kB N1
mdp-28-14-sat.cnfminimum-disagreement-parity -n 28 -t 7 -s 14 04ded9445483… 9 kB N1
mdp-28-14-unsat.cnfminimum-disagreement-parity -n 28 -t 6 -s 14 1548977b4e27… 9 kB N1
mdp-28-16-sat.cnfminimum-disagreement-parity -n 28 -t 7 -s 16 090585dc32a7… 9 kB N1
mdp-28-16-unsat.cnfminimum-disagreement-parity -n 28 -t 6 -s 16 37a11ae189df… 10 kB N1
mdp-32-10-sat.cnfminimum-disagreement-parity -n 32 -t 8 -s 10 8ffd718f763e… 12 kB N1
mdp-32-10-unsat.cnfminimum-disagreement-parity -n 32 -t 7 -s 10 1e7421216812… 12 kB N1
mdp-32-11-sat.cnfminimum-disagreement-parity -n 32 -t 8 -s 11 db15a85651e0… 12 kB N1
mdp-32-11-unsat.cnfminimum-disagreement-parity -n 32 -t 7 -s 11 4f2d6659b5c9… 12 kB N1
mdp-32-12-sat.cnfminimum-disagreement-parity -n 32 -t 8 -s 12 3e2fe1556893… 12 kB N1
mdp-32-12-unsat.cnfminimum-disagreement-parity -n 32 -t 7 -s 12 425c81fc3af7… 11 kB N1
mdp-32-14-sat.cnfminimum-disagreement-parity -n 32 -t 8 -s 14 d11944fbca2d… 12 kB N1
mdp-32-14-unsat.cnfminimum-disagreement-parity -n 32 -t 7 -s 14 23daec2c71ce… 12 kB --
mdp-32-16-sat.cnfminimum-disagreement-parity -n 32 -t 8 -s 16 a9cb77454c6c… 12 kB N1
mdp-32-16-unsat.cnfminimum-disagreement-parity -n 32 -t 7 -s 16 59047491e482… 11 kB N1
mdp-36-10-sat.cnfminimum-disagreement-parity -n 36 -t 9 -s 10 a5dc6226e4c0… 15 kB N1
mdp-36-10-unsat.cnfminimum-disagreement-parity -n 36 -t 8 -s 10 16ca57f2cdff… 14 kB N4
mdp-36-11-sat.cnfminimum-disagreement-parity -n 36 -t 9 -s 11 6fa8b4b7f4b0… 15 kB N1
mdp-36-11-unsat.cnfminimum-disagreement-parity -n 36 -t 8 -s 11 b043968ec004… 15 kB N1
mdp-36-12-sat.cnfminimum-disagreement-parity -n 36 -t 9 -s 12 f9dd957b2f59… 15 kB N1
mdp-36-12-unsat.cnfminimum-disagreement-parity -n 36 -t 8 -s 12 9a06700729bf… 14 kB N1
mdp-36-14-sat.cnfminimum-disagreement-parity -n 36 -t 9 -s 14 ab3438b504b2… 15 kB N1
mdp-36-14-unsat.cnfminimum-disagreement-parity -n 36 -t 8 -s 14 e6f793931983… 15 kB N1
mdp-36-16-sat.cnfminimum-disagreement-parity -n 36 -t 9 -s 16 d40af7b45bba… 15 kB N1
mdp-36-16-unsat.cnfminimum-disagreement-parity -n 36 -t 8 -s 16 2a43c3327fb8… 14 kB N1

Notes