The programs that produce SAT benchmarks, each as a Docker image: the families the competitions used, and others that live outside them, in papers and in solver tuning.

A pilot, and a collective one: please check, correct and contribute. Everything here is generated from the data of the sat-heritage/benchs-generators repository. A generator whose licence is unknown has its recipe published but no image, and a family with no generator is one we could not find or could not run: corrections, missing generators and licence clarifications are welcome as pull requests or issues. Adding your own generator takes four files, or just an issue with a link to your code: see adding a generator. The companion project for solvers is SAT Heritage.
Overview · Families

brent-equations

Solver rankings on this family, and the generator that reproduces it.

What to run on a problem of this kind

The solvers that did best on this family in the SAT Competition 2023, as images of the companion project. They are a better bet on such a problem than the overall winner of that year, which this family often disagrees with.

SolverSolvedCommand
Cadical_rel_1.5.3.Scavel19 / 19 no image published for this solver yet
MapleCaDiCaL_LBD-990_50019 / 19
docker run --rm -v "$PWD:/data" satex/maplecadical-lbd-990-500:2023 your-instance.cnf
MapleCaDiCaL_PPD-950_95019 / 19
docker run --rm -v "$PWD:/data" satex/maplecadical-ppd-950-950:2023 your-instance.cnf

No generator here yet

We have not packaged a generator for this family. If you wrote it, or know where its code lives, a issue is very welcome.

SAT Competition 2023 · 19 instances

Ranked by PAR-2 on this family alone. Winner of the whole main track that year: SBVA-sbva_cadical.

#SolverSolvedPAR-2 per instance
1Cadical_rel_1.5.3.Scavel 19 / 19154 s
2MapleCaDiCaL_LBD-990_500 19 / 19155 s
3MapleCaDiCaL_PPD-950_950 19 / 19174 s
4CaDiCaL_vivinst 19 / 19176 s
5Cadical_ESA 19 / 19184 s
6MapleCaDiCaL_PPD-500_500 19 / 19190 s
7hKis-unsat 19 / 19196 s
8MapleCaDiCaL_LBD-990_275 19 / 19204 s
9SBVA-sbva_cadical 19 / 19233 s
10kissat-3.1.0 19 / 19250 s
11Kissat_MAB_Conflict+ 19 / 19284 s
12Kissat_MAB_Rephases 19 / 19285 s