The programs that produce SAT benchmarks, each as a Docker image: the families the competitions used, and others that live outside them, in papers and in solver tuning.

A pilot, and a collective one: please check, correct and contribute. Everything here is generated from the data of the sat-heritage/benchs-generators repository. A generator whose licence is unknown has its recipe published but no image, and a family with no generator is one we could not find or could not run: corrections, missing generators and licence clarifications are welcome as pull requests or issues. Adding your own generator takes four files, or just an issue with a link to your code: see adding a generator. The companion project for solvers is SAT Heritage.
Overview · Families

grs-fp-comm

Solver rankings on this family, and the generator that reproduces it.

What to run on a problem of this kind

The solvers that did best on this family in the SAT Competition 2023, as images of the companion project. They are a better bet on such a problem than the overall winner of that year, which this family often disagrees with.

SolverSolvedCommand
hKissatInc-unsat15 / 17 
docker run --rm -v "$PWD:/data" satex/hkissatinc-unsat:2023 your-instance.cnf
hKis-unsat14 / 17 
docker run --rm -v "$PWD:/data" satex/hkis-unsat:2023 your-instance.cnf
Kissat_MAB_prop14 / 17 
docker run --rm -v "$PWD:/data" satex/kissat-mab-prop:2023 your-instance.cnf

No generator here yet

We have not packaged a generator for this family. If you wrote it, or know where its code lives, a issue is very welcome.

SAT Competition 2023 · 17 instances

Ranked by PAR-2 on this family alone. Winner of the whole main track that year: SBVA-sbva_cadical.

#SolverSolvedPAR-2 per instance
1hKissatInc-unsat 15 / 172215 s
2hKis-unsat 14 / 172645 s
3Kissat_MAB_prop 14 / 173113 s
4hKis-psids 13 / 173144 s
5kissat-hywalk-exp 13 / 173258 s
6Kissat_MAB_prop-no_sym 13 / 173422 s
7Kissat_MAB_prop_pr-no_sym 13 / 173436 s
8hKis-sat_psids 12 / 173563 s
9Kissat_MAB_Binary 12 / 173582 s
10Kissat_MAB_ESA 12 / 173644 s
11SBVA-sbva_cadical 12 / 173650 s
12CaDiCaL_vivinst 12 / 173660 s