Sparkle SAT Challenge 2018

The slides used at the 2018 SAT Conference.

Extended slide deck (with additional results + observations, including the analysis with regarding to VBS) can be found here.

[Official Results] Ranking according to marginal contribution on testing set, without hors-concours solvers

Rank Solver rel. marginal contribution PAR2 (stand-alone) Note
1 CryptoMiniSatv5.5 12.97% 4740.02
2 ReasonLS 9.68% 4775.40
3 minisat-2.2.0_PADC 9.07% 5925.19
4 glucose-3.0_PADC 8.41% 6065.19
5 UPLS 8.18% 8569.31
6 Riss7 7.81% 5336.48
7 probSAT 6.99% 9041.22
8 CaDiCaL 6.93% 5372.57
9 glu_mix 6.20% 5668.08
10 BreakIDGlucoseSEL 5.42% 5702.63
11 gluHack 4.48% 6058.92
12 Riss7-no-preprocessor 3.84% 5589.32
13 smallsat 3.51% 5355.53
14 YalSAT 3.39% 8664.83
15 SparrowToRiss-2018 1.37% 4961.07
16 Lingeling 1.32% 5461.16
17 Minisat-v2.2.0-68-g37dc6c6 0.43% 5972.24
18 CPSparrow 0.00% 8498.08
18 Dimetheus 0.00% 8798.94