| Benchmark | #Ins. | MaxHS | EvalMaxSAT | UWrMaxSat | RC2-B | open-wbo-res-mergesat-v2 | open-wbo-res-mergesat-v1 | RC2-A | maxino | open-wbo-res-glucose-v2 | open-wbo-res-glucose-v1 | maxino-pref | Pacose | QMaxSAT | smax_mergesat | smax_minisat |
|---|
| security-witness | 30 | 77.71 (30) | 44.0 (30) | 158.83 (30) | 456.14 (26) | 56.88 (30) | 62.88 (30) | 262.2 (26) | 454.65 (25) | 39.63 (30) | 45.66 (30) | 582.04 (26) | 88.08 (30) | 711.64 (14) | 194.47 (30) | 118.61 (30) |
| single_machine_scheduling | 30 | 292.25 (10) | 163.5 (11) | 275.5 (10) | 194.29 (10) | 780.53 (14) | 784.67 (15) | 397.64 (11) | 344.16 (11) | 823.94 (14) | 788.39 (16) | 347.38 (10) | 800.49 (18) | 633.45 (16) | 1257.34 (3) | 1433.17 (3) |
| scheduling | 5 | 764.97 (2) | 527.8 (2) | 311.26 (2) | 364.24 (1) | 1535.56 (2) | 1542.6 (2) | 170.26 (1) | 127.34 (2) | 256.42 (1) | 266.66 (1) | 748.63 (2) | 1810.72 (2) | 1120.05 (2) | 0.0 (0) | 0.0 (0) |
| uaq_2020 | 17 | 110.33 (13) | 273.49 (14) | 71.64 (13) | 28.41 (13) | 447.44 (15) | 506.71 (13) | 32.67 (13) | 167.38 (13) | 53.13 (13) | 52.86 (11) | 340.85 (11) | 21.29 (11) | 243.28 (11) | 215.16 (11) | 166.46 (11) |
| frb | 10 | 61.77 (9) | 129.46 (10) | 80.45 (10) | 84.07 (10) | 161.21 (9) | 51.23 (10) | 32.48 (10) | 291.13 (5) | 131.68 (8) | 118.5 (10) | 122.71 (2) | 115.89 (10) | 225.18 (10) | 0.0 (0) | 0.0 (0) |
| uaq | 12 | 16.87 (9) | 20.08 (9) | 14.35 (9) | 15.36 (9) | 81.04 (8) | 80.68 (8) | 14.63 (9) | 44.0 (9) | 45.88 (8) | 47.17 (8) | 118.27 (6) | 38.45 (8) | 59.21 (8) | 97.9 (6) | 560.39 (7) |
| RBAC-violations-multiple | 30 | 46.09 (30) | 36.49 (30) | 14.21 (30) | 23.99 (30) | 0.86 (30) | 2.89 (30) | 12.16 (30) | 4.32 (30) | 0.59 (30) | 1.35 (30) | 4.35 (30) | 14.46 (23) | 13.36 (23) | 5.35 (30) | 2.99 (30) |
| maxone | 17 | 3.36 (17) | 0.92 (17) | 0.97 (17) | 1.64 (17) | 7.02 (17) | 5.0 (17) | 2.46 (17) | 0.93 (17) | 3.45 (17) | 2.87 (17) | 0.19 (15) | 0.68 (17) | 0.92 (17) | 55.48 (17) | 65.78 (17) |
| program_disambiguation | 19 | 181.69 (16) | 350.32 (17) | 266.01 (18) | 433.15 (17) | 539.32 (17) | 492.79 (17) | 360.8 (17) | 252.71 (17) | 257.46 (17) | 262.96 (17) | 282.25 (17) | 236.02 (17) | 315.59 (15) | 230.51 (13) | 147.38 (14) |
| close_solutions | 6 | 182.26 (6) | 37.58 (6) | 46.01 (6) | 826.6 (6) | 181.57 (6) | 187.88 (6) | 358.6 (6) | 75.95 (6) | 7.07 (5) | 23.16 (5) | 83.82 (6) | 35.98 (5) | 173.71 (4) | 77.78 (6) | 29.03 (6) |
| des | 8 | 407.77 (8) | 209.22 (8) | 109.55 (8) | 174.93 (7) | 137.07 (6) | 138.7 (6) | 393.86 (8) | 115.26 (7) | 123.27 (8) | 117.81 (8) | 615.3 (5) | 240.09 (8) | 486.82 (8) | 1170.19 (2) | 758.21 (2) |
| kbtree | 10 | 91.3 (10) | 665.87 (4) | 637.0 (4) | 15.37 (2) | 730.14 (5) | 730.1 (5) | 15.04 (2) | 91.3 (2) | 702.12 (5) | 698.49 (5) | 0.15 (1) | 100.11 (2) | 49.83 (2) | 1029.0 (3) | 19.26 (2) |
| reversi | 10 | 1.2 (4) | 0.96 (4) | 0.31 (4) | 0.75 (4) | 0.46 (4) | 0.47 (4) | 0.41 (4) | 0.43 (4) | 0.25 (4) | 0.25 (4) | 0.71 (4) | 0.21 (4) | 0.17 (4) | 9.57 (4) | 3.01 (4) |
| set_cover_sts | 4 | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) |
| extension-enforcement | 11 | 69.49 (5) | 200.96 (6) | 531.46 (9) | 73.69 (5) | 954.56 (5) | 891.69 (5) | 66.53 (3) | 1.17 (5) | 105.19 (1) | 1238.05 (2) | 1.1 (5) | 0.0 (0) | 0.0 (0) | 1958.87 (2) | 558.84 (1) |
| large-graph-commmunity | 8 | 0.03 (5) | 0.02 (5) | 0.02 (5) | 0.12 (5) | 0.02 (5) | 0.03 (5) | 0.11 (5) | 0.01 (5) | 0.02 (5) | 0.02 (5) | 0.02 (5) | 0.14 (5) | 0.21 (5) | 0.02 (5) | 0.02 (5) |
| atcoss | 13 | 412.47 (8) | 562.06 (7) | 41.06 (7) | 258.15 (7) | 165.15 (7) | 161.31 (7) | 258.03 (7) | 50.78 (7) | 449.11 (7) | 447.83 (7) | 52.49 (7) | 103.46 (6) | 321.69 (7) | 427.12 (5) | 777.64 (6) |
| phylogentic-trees | 30 | 1122.35 (22) | 972.03 (28) | 655.66 (26) | 1043.63 (27) | 530.02 (4) | 502.89 (4) | 742.64 (4) | 604.65 (10) | 193.11 (2) | 1443.45 (5) | 956.04 (7) | 971.71 (12) | 1457.44 (8) | 0.0 (0) | 0.0 (0) |
| min-fill | 12 | 281.53 (6) | 196.86 (6) | 0.84 (2) | 208.05 (6) | 0.19 (1) | 0.19 (1) | 811.59 (4) | 189.16 (3) | 0.13 (1) | 0.13 (1) | 11.08 (2) | 126.6 (2) | 1611.67 (3) | 2.07 (1) | 1.11 (1) |
| ConsistentQueryAnswering | 13 | 0.31 (13) | 0.35 (13) | 0.56 (13) | 39.05 (13) | 1.4 (13) | 20.16 (13) | 38.97 (13) | 1.01 (13) | 1.34 (13) | 2.13 (13) | 1.01 (13) | 11.07 (13) | 23.98 (13) | 273.13 (12) | 140.4 (12) |
| set-covering | 9 | 25.63 (1) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) |
| ramsey | 11 | 0.96 (1) | 7.24 (1) | 0.25 (1) | 2.25 (1) | 1.17 (1) | 1.1 (1) | 0.59 (1) | 1.1 (1) | 1.67 (1) | 1.58 (1) | 1.08 (1) | 0.65 (1) | 0.0 (0) | 1.16 (1) | 0.59 (1) |
| aes-key-recovery | 19 | 390.25 (18) | 64.26 (19) | 41.4 (19) | 187.11 (19) | 194.65 (18) | 180.25 (18) | 159.0 (19) | 33.61 (18) | 307.86 (19) | 306.44 (19) | 11.91 (18) | 0.2 (3) | 1246.05 (3) | 186.78 (15) | 119.0 (15) |
| packup | 11 | 3.02 (11) | 4.84 (11) | 2.71 (11) | 6.69 (11) | 5.35 (11) | 24.14 (11) | 6.41 (11) | 3.01 (11) | 2.05 (11) | 18.38 (11) | 2.65 (11) | 8.06 (11) | 6.73 (11) | 64.62 (11) | 27.87 (11) |
| MaxSATQueriesinInterpretableClassifiers | 7 | 0.43 (4) | 0.06 (4) | 0.03 (4) | 0.17 (4) | 0.21 (4) | 1.77 (4) | 0.16 (4) | 0.07 (4) | 0.11 (4) | 0.62 (4) | 0.23 (4) | 2.42 (4) | 4.14 (4) | 2.19 (4) | 1.16 (4) |
| drmx-atmostk | 14 | 59.66 (14) | 15.67 (14) | 54.5 (14) | 15.73 (14) | 3.29 (14) | 3.22 (14) | 14.24 (14) | 323.56 (14) | 3.5 (14) | 3.52 (14) | 139.48 (14) | 0.65 (14) | 0.69 (14) | 790.68 (13) | 619.8 (12) |
| SeanSafarpour | 15 | 397.09 (11) | 67.87 (12) | 247.95 (13) | 79.05 (12) | 116.78 (12) | 62.34 (12) | 79.13 (12) | 94.81 (12) | 57.49 (12) | 65.72 (12) | 162.51 (13) | 407.78 (10) | 217.96 (8) | 70.98 (12) | 68.69 (12) |
| logic-synthesis | 17 | 0.66 (16) | 199.03 (14) | 157.23 (10) | 347.0 (12) | 138.38 (11) | 50.2 (10) | 97.8 (10) | 8.77 (10) | 177.53 (10) | 59.93 (10) | 224.89 (10) | 62.33 (6) | 114.47 (6) | 206.96 (9) | 95.12 (8) |
| railroad_scheduling | 14 | 53.57 (4) | 249.79 (2) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) |
| gen-hyper-tw | 11 | 741.24 (5) | 1306.25 (4) | 862.48 (6) | 977.45 (3) | 303.11 (7) | 315.0 (7) | 1006.85 (3) | 1168.36 (4) | 1077.36 (3) | 1074.34 (3) | 1162.56 (4) | 40.24 (2) | 78.87 (2) | 1330.91 (7) | 0.05 (1) |
| protein_ins | 12 | 138.31 (12) | 35.71 (12) | 96.95 (12) | 88.37 (12) | 129.69 (12) | 88.23 (12) | 61.57 (12) | 265.03 (12) | 213.07 (12) | 160.43 (12) | 110.12 (3) | 51.8 (12) | 50.78 (12) | 2.73 (1) | 0.57 (1) |
| fault-diagnosis | 10 | 178.02 (10) | 121.16 (10) | 168.24 (10) | 84.1 (10) | 390.24 (10) | 317.11 (10) | 65.54 (10) | 114.37 (10) | 99.42 (10) | 114.43 (10) | 114.12 (10) | 277.06 (10) | 279.15 (8) | 301.41 (7) | 883.52 (9) |
| maxcut | 11 | 21.21 (1) | 14.29 (1) | 3.76 (1) | 78.48 (1) | 536.79 (1) | 705.95 (1) | 64.33 (1) | 75.2 (1) | 408.76 (1) | 357.14 (1) | 0.0 (0) | 837.51 (1) | 943.44 (1) | 658.64 (1) | 1032.28 (1) |
| aes | 7 | 363.13 (2) | 0.33 (1) | 1.68 (1) | 0.36 (1) | 0.17 (1) | 0.17 (1) | 0.42 (1) | 0.32 (1) | 0.13 (1) | 0.13 (1) | 0.51 (1) | 1133.67 (1) | 1917.73 (1) | 0.62 (1) | 0.19 (1) |
| exploits-synthesis | 3 | 1274.3 (3) | 340.5 (1) | 1018.01 (3) | 1324.4 (3) | 1002.22 (2) | 1040.43 (2) | 1755.14 (2) | 933.03 (3) | 579.49 (2) | 570.09 (2) | 3318.38 (1) | 758.27 (3) | 800.22 (3) | 0.0 (0) | 0.0 (0) |
| mbd | 12 | 54.42 (12) | 6.31 (12) | 2.46 (12) | 6.31 (12) | 5.83 (12) | 6.22 (12) | 6.77 (12) | 5.72 (12) | 4.04 (12) | 4.13 (12) | 22.83 (12) | 229.2 (12) | 289.04 (12) | 71.42 (12) | 32.87 (12) |
| xai-mindset2 | 10 | 31.77 (6) | 126.91 (7) | 303.47 (7) | 416.2 (7) | 3.78 (5) | 52.53 (5) | 2.98 (5) | 10.03 (5) | 3.64 (5) | 157.42 (5) | 601.33 (4) | 1.92 (3) | 1.28 (3) | 210.66 (5) | 79.72 (5) |
| treewidth-computation | 13 | 137.7 (12) | 2.96 (10) | 491.8 (12) | 433.77 (12) | 152.01 (12) | 245.5 (12) | 432.35 (12) | 338.81 (12) | 25.09 (10) | 76.89 (11) | 338.93 (12) | 156.5 (11) | 41.41 (12) | 157.98 (10) | 137.49 (10) |
| CircuitDebuggingProblems | 9 | 25.06 (9) | 21.36 (9) | 10.45 (9) | 165.23 (9) | 4.11 (9) | 3.91 (9) | 44.79 (9) | 21.89 (9) | 3.01 (9) | 3.27 (9) | 22.6 (9) | 11.85 (8) | 273.04 (7) | 3.38 (9) | 2.65 (9) |
| pseudoBoolean | 7 | 16.11 (6) | 8.76 (6) | 4.22 (6) | 8.13 (6) | 11.49 (6) | 11.4 (6) | 7.85 (6) | 21.56 (6) | 5.27 (6) | 5.38 (6) | 24.31 (6) | 1.89 (6) | 1.61 (6) | 98.88 (6) | 57.55 (6) |
| maxclique | 11 | 43.37 (9) | 11.82 (9) | 18.2 (9) | 14.19 (9) | 375.43 (9) | 85.94 (9) | 18.17 (9) | 463.42 (7) | 232.72 (9) | 85.94 (9) | 488.27 (6) | 249.83 (6) | 248.86 (6) | 617.31 (4) | 866.94 (4) |
| optic | 8 | 70.94 (7) | 768.26 (5) | 15.05 (2) | 8.99 (2) | 7.1 (1) | 7.06 (1) | 6.03 (2) | 687.75 (3) | 71.58 (2) | 70.16 (2) | 2.99 (2) | 0.0 (0) | 0.0 (0) | 83.28 (4) | 532.77 (3) |
| railway-transport | 6 | 61.12 (2) | 23.68 (2) | 12.66 (2) | 32.03 (2) | 37.42 (2) | 45.38 (2) | 27.9 (2) | 9.38 (2) | 30.77 (2) | 31.59 (2) | 13.71 (2) | 345.45 (3) | 585.27 (3) | 318.05 (2) | 53.33 (2) |
| drmx-cryptogen | 8 | 24.64 (8) | 23.94 (8) | 16.23 (8) | 212.3 (8) | 89.61 (8) | 0.0 (0) | 210.36 (8) | 34.2 (8) | 30.48 (8) | 0.0 (0) | 34.7 (8) | 0.0 (0) | 0.0 (0) | 581.63 (8) | 120.24 (8) |
| MaximumCommonSub-GraphExtraction | 8 | 68.15 (7) | 426.4 (8) | 51.8 (7) | 111.02 (7) | 362.29 (8) | 300.46 (8) | 135.28 (7) | 56.82 (6) | 158.26 (7) | 131.43 (7) | 336.13 (6) | 212.83 (7) | 246.26 (7) | 409.58 (1) | 803.84 (1) |
| bcp | 7 | 0.16 (7) | 0.11 (7) | 0.13 (7) | 0.53 (7) | 0.27 (7) | 0.25 (7) | 0.5 (7) | 0.14 (7) | 0.18 (7) | 0.28 (7) | 0.14 (7) | 0.08 (7) | 0.13 (7) | 3.96 (7) | 93.44 (7) |
| HaplotypeAssembly | 6 | 8.86 (5) | 176.51 (6) | 183.21 (6) | 33.77 (6) | 1.02 (5) | 2.17 (5) | 116.97 (6) | 1.41 (5) | 0.86 (5) | 1.43 (5) | 1.37 (5) | 43.03 (5) | 9.42 (5) | 1.05 (5) | 0.41 (5) |
| hs-timetabling | 1 | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) |
| CircuitTraceCompaction | 4 | 27.8 (4) | 41.07 (4) | 9.15 (4) | 42.58 (4) | 29.62 (4) | 26.0 (4) | 37.81 (4) | 8.15 (4) | 22.46 (4) | 21.67 (4) | 6.6 (4) | 15.9 (4) | 16.54 (4) | 248.65 (4) | 123.54 (4) |
| Total | 576 | 180.16 (430) | 182.01 (426) | 163.59 (419) | 226.4 (409) | 188.05 (390) | 176.7 (381) | 146.46 (379) | 161.56 (378) | 129.58 (375) | 153.35 (374) | 198.3 (347) | 183.32 (343) | 260.49 (315) | 240.04 (309) | 185.69 (303) |