MaxSAT Evaluation 2017: Results of Unweighted Complete Track Per Benchmark Family
Benchmark | #Ins. | Open-WBO-RES | Open-WBO-MSE16✝ | MaxHS | maxino | MSUSorting | QMaxSATuc | Z3✝ | QMaxSAT | LMHS | Open-WBO-LSU | CPLEX✝ |
extension-enforcement | 35 | 628.32 (9) | 623.48 (10) | 188.37 (15) | 1.35 (17) | 867.16 (8) | 0.0 (0) | 26.81 (17) | 0.0 (0) | 1221.46 (20) | 0.0 (0) | 85.16 (35) |
haplotype-assembly | 6 | 1.47 (5) | 2.11 (5) | 11.6 (5) | 1.43 (5) | 21.06 (5) | 6.23 (5) | 6.02 (5) | 6.31 (5) | 11.66 (5) | 44.96 (5) | 1005.79 (5) |
pbo-mqc-nencdr | 25 | 22.32 (25) | 27.39 (25) | 38.51 (25) | 19.02 (25) | 67.79 (25) | 37.55 (25) | 359.8 (23) | 33.84 (25) | 52.87 (25) | 42.44 (25) | 346.05 (1) |
protein-ins | 12 | 169.87 (12) | 122.44 (12) | 102.18 (3) | 267.83 (12) | 139.94 (12) | 67.51 (12) | 1252.65 (10) | 59.7 (12) | 184.44 (3) | 95.53 (12) | 0.29 (1) |
gen-hyper-tw | 35 | 974.25 (7) | 658.12 (7) | 314.62 (5) | 1057.05 (9) | 926.24 (7) | 889.78 (8) | 254.56 (5) | 67.16 (5) | 617.1 (7) | 65.35 (5) | 43.26 (1) |
kbtree | 24 | 3078.36 (5) | 1465.81 (3) | 56.72 (24) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 1524.66 (12) | 0.0 (0) | 152.93 (24) |
maxclique | 35 | 225.6 (24) | 105.53 (22) | 79.68 (21) | 150.67 (17) | 310.95 (18) | 373.08 (20) | 168.44 (17) | 329.32 (20) | 356.74 (23) | 319.07 (19) | 370.01 (24) |
maxcut | 30 | 66.98 (6) | 47.14 (6) | 501.2 (13) | 268.6 (8) | 113.9 (6) | 135.57 (6) | 84.72 (6) | 176.6 (6) | 1.4 (4) | 81.5 (6) | 336.49 (16) |
min-fill | 27 | 368.29 (4) | 178.56 (4) | 236.77 (14) | 86.21 (7) | 349.61 (5) | 86.61 (6) | 1.01 (3) | 484.63 (6) | 615.12 (14) | 60.35 (5) | 1351.7 (2) |
treewidth-computation | 33 | 79.87 (24) | 205.87 (25) | 126.53 (25) | 184.74 (26) | 159.55 (25) | 218.95 (26) | 133.79 (24) | 172.08 (26) | 164.06 (25) | 88.59 (26) | 3101.09 (2) |
reversi | 35 | 15.42 (27) | 119.57 (28) | 8.91 (25) | 16.95 (27) | 103.05 (28) | 122.7 (28) | 91.2 (27) | 89.8 (28) | 21.01 (25) | 73.93 (28) | 618.59 (11) |
atcoss-mesat | 18 | 197.72 (11) | 175.3 (11) | 309.9 (12) | 123.48 (12) | 145.13 (11) | 136.19 (11) | 384.56 (11) | 579.63 (13) | 293.93 (12) | 503.69 (13) | 0.0 (0) |
atcoss-sugar | 19 | 246.21 (12) | 127.2 (12) | 35.48 (12) | 26.98 (12) | 109.72 (12) | 110.09 (12) | 170.06 (11) | 146.96 (12) | 34.48 (12) | 301.35 (12) | 0.0 (0) |
hs-timetabling | 2 | 67.7 (1) | 64.11 (1) | 8.77 (1) | 378.67 (1) | 28.67 (1) | 22.33 (1) | 2036.35 (1) | 146.38 (1) | 83.27 (1) | 0.0 (0) | 0.0 (0) |
job-shop | 3 | 31.96 (3) | 30.26 (3) | 27.32 (3) | 34.38 (3) | 21.67 (3) | 15.35 (3) | 244.79 (3) | 10.34 (3) | 50.22 (3) | 9.74 (3) | 0.0 (0) |
pbo-routing | 15 | 1.46 (15) | 1.77 (15) | 16.51 (15) | 1.19 (15) | 0.56 (15) | 1.05 (15) | 1.2 (15) | 0.96 (15) | 7.45 (15) | 1.46 (15) | 27.12 (15) |
scheduling | 5 | 269.6 (1) | 1497.37 (2) | 2014.01 (1) | 125.05 (2) | 285.88 (1) | 1597.02 (2) | 1539.65 (1) | 1666.2 (2) | 0.0 (0) | 1069.35 (1) | 0.0 (0) |
set-covering | 10 | 0.0 (0) | 0.0 (0) | 1729.61 (2) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 1247.21 (2) | 0.0 (0) | 1959.37 (1) |
close-solutions | 35 | 222.26 (34) | 244.18 (33) | 317.44 (34) | 60.14 (34) | 61.48 (35) | 135.26 (33) | 298.93 (35) | 430.44 (32) | 462.85 (23) | 225.28 (29) | 152.24 (26) |
frb | 25 | 54.09 (25) | 22.32 (25) | 43.26 (25) | 290.71 (9) | 123.29 (25) | 36.29 (25) | 0.0 (0) | 46.62 (25) | 519.86 (14) | 72.14 (25) | 511.75 (13) |
maxone | 25 | 6.33 (25) | 7.13 (25) | 2.06 (25) | 1.06 (25) | 3.88 (25) | 0.72 (25) | 3.82 (25) | 0.69 (25) | 2.93 (25) | 0.61 (25) | 121.96 (24) |
aes | 7 | 0.14 (1) | 0.14 (1) | 92.33 (2) | 0.34 (1) | 0.92 (1) | 1647.9 (1) | 43.01 (1) | 1746.71 (1) | 201.68 (2) | 3182.8 (1) | 445.85 (3) |
bcp-fir | 32 | 14.75 (32) | 16.54 (32) | 142.61 (31) | 7.94 (32) | 71.84 (32) | 140.68 (30) | 34.01 (31) | 155.93 (30) | 180.72 (27) | 96.01 (30) | 15.4 (32) |
bcp-msp | 35 | 106.15 (21) | 103.16 (21) | 182.62 (19) | 534.51 (18) | 1055.48 (13) | 342.89 (9) | 101.08 (18) | 336.16 (9) | 99.62 (19) | 743.99 (14) | 270.13 (16) |
bcp-syn | 35 | 162.64 (21) | 185.91 (18) | 28.75 (33) | 83.65 (23) | 380.8 (16) | 620.2 (7) | 37.56 (16) | 475.76 (7) | 61.46 (33) | 206.05 (6) | 18.38 (33) |
circuit-trace | 4 | 19.85 (4) | 23.33 (4) | 150.3 (2) | 7.29 (4) | 22.5 (4) | 17.44 (4) | 126.27 (4) | 15.25 (4) | 1495.06 (2) | 14.84 (4) | 405.43 (1) |
fault-diagnosis | 35 | 173.83 (31) | 170.41 (32) | 1046.38 (7) | 135.11 (31) | 41.75 (29) | 98.41 (29) | 161.36 (32) | 135.16 (30) | 1165.9 (7) | 119.79 (28) | 0.0 (0) |
packup | 35 | 26.84 (35) | 25.26 (35) | 3.72 (35) | 1.45 (35) | 6.26 (35) | 3.9 (35) | 8.88 (35) | 3.97 (35) | 10.14 (34) | 8.98 (35) | 0.9 (35) |
tpr-multiple-path | 35 | 96.72 (35) | 101.56 (35) | 66.87 (35) | 29.71 (35) | 160.45 (35) | 109.49 (35) | 245.73 (31) | 116.97 (35) | 123.11 (35) | 108.21 (35) | 2063.87 (7) |
aes-key-recovery | 35 | 112.63 (33) | 253.46 (34) | 295.05 (27) | 11.34 (33) | 34.29 (31) | 170.97 (16) | 132.61 (34) | 761.51 (10) | 84.32 (20) | 0.0 (0) | 1727.99 (1) |
bcp-hipp | 35 | 57.98 (32) | 66.86 (32) | 283.38 (27) | 132.81 (32) | 169.49 (32) | 62.53 (32) | 75.09 (29) | 58.74 (32) | 224.66 (24) | 64.16 (32) | 0.0 (0) |
bcp-mtg | 30 | 0.34 (30) | 0.31 (30) | 1.34 (30) | 0.23 (30) | 0.18 (30) | 0.16 (30) | 3.94 (30) | 0.17 (30) | 3.4 (30) | 0.13 (30) | 343.91 (18) |
circuit-debugging | 3 | 3.79 (3) | 3.56 (3) | 60.28 (3) | 28.55 (3) | 106.22 (3) | 112.5 (2) | 333.9 (2) | 214.21 (1) | 182.93 (2) | 909.96 (2) | 661.9 (1) |
des | 35 | 105.02 (35) | 149.52 (35) | 651.83 (35) | 152.89 (33) | 533.49 (35) | 337.45 (35) | 267.1 (13) | 401.9 (35) | 704.19 (17) | 325.27 (35) | 563.99 (11) |
mbd | 35 | 50.74 (35) | 16.62 (34) | 190.07 (35) | 47.87 (34) | 38.16 (34) | 203.2 (32) | 120.91 (33) | 234.01 (33) | 175.99 (32) | 328.08 (34) | 707.06 (29) |
sean-safarpour | 35 | 103.25 (29) | 250.95 (31) | 423.7 (25) | 131.17 (29) | 419.86 (25) | 990.9 (13) | 1010.65 (22) | 717.22 (13) | 343.75 (12) | 1292.05 (11) | 370.47 (4) |
Total | 880 | 129.9 (652) | 130.61 (651) | 182.61 (651) | 99.14 (639) | 171.96 (622) | 165.19 (573) | 187.51 (570) | 192.95 (566) | 264.11 (566) | 180.55 (551) | 296.84 (392) |
✝ Non-competitive solver.