MaxSAT Evaluation 2017: Results of Weighted Complete Track Per Benchmark Family
| Benchmark | #Ins. | MaxHS | MaxHS-MSE16✝ | QMaxSAT | QMaxSATuc | maxino | Open-WBO-OLL | Loandra-S | Loandra-P | LMHS | Loandra-I | Z3✝ | Open-WBO-LSU | CPLEX✝ |
|---|
| auc-paths | 20 | 0.09 (20) | 0.1 (20) | 749.02 (14) | 948.72 (15) | 55.37 (20) | 121.89 (20) | 83.32 (18) | 178.01 (18) | 0.08 (20) | 178.3 (18) | 679.15 (10) | 0.0 (0) | 0.03 (20) |
| auc-scheduling | 20 | 0.09 (20) | 0.06 (20) | 4.83 (20) | 4.96 (20) | 0.03 (20) | 0.03 (20) | 0.03 (20) | 0.26 (20) | 0.4 (20) | 0.26 (20) | 3.52 (20) | 732.46 (4) | 0.12 (20) |
| af-synthesis | 35 | 1973.14 (6) | 1824.5 (5) | 1441.91 (33) | 1305.37 (32) | 2465.33 (15) | 2156.77 (16) | 2344.56 (9) | 3143.38 (3) | 2736.89 (1) | 3146.18 (3) | 3467.47 (1) | 601.61 (35) | 0.0 (0) |
| biorepair | 30 | 4.32 (30) | 5.1 (30) | 9.27 (30) | 2.54 (30) | 1.78 (30) | 19.14 (30) | 2.81 (30) | 4.42 (30) | 3.8 (30) | 4.42 (30) | 41.84 (30) | 5.23 (30) | 46.2 (30) |
| haplotyping-pedigrees | 35 | 186.15 (33) | 278.78 (33) | 328.14 (30) | 518.81 (32) | 6.63 (35) | 15.45 (33) | 24.89 (35) | 5.91 (35) | 297.61 (22) | 5.92 (35) | 127.67 (34) | 37.1 (35) | 856.61 (3) |
| rna-alignment | 35 | 594.71 (21) | 346.97 (21) | 29.71 (35) | 29.93 (35) | 20.19 (21) | 20.13 (21) | 45.56 (21) | 122.57 (21) | 663.86 (20) | 122.86 (21) | 398.81 (20) | 137.08 (35) | 277.84 (3) |
| maxcut | 30 | 504.1 (20) | 378.37 (16) | 814.64 (6) | 836.91 (6) | 202.53 (2) | 1246.15 (3) | 908.03 (2) | 1111.68 (4) | 543.32 (6) | 1106.59 (4) | 371.29 (1) | 1216.85 (2) | 514.36 (18) |
| csg | 10 | 11.4 (10) | 13.53 (10) | 56.47 (10) | 66.31 (10) | 47.64 (10) | 331.0 (9) | 131.6 (8) | 167.8 (7) | 10.71 (10) | 166.86 (7) | 526.79 (10) | 43.83 (4) | 123.62 (4) |
| hs-timetabling | 14 | 1395.41 (4) | 1663.9 (3) | 1809.41 (1) | 1915.93 (1) | 809.46 (1) | 769.26 (1) | 2270.73 (1) | 1012.83 (2) | 1077.61 (3) | 1004.31 (2) | 1666.04 (2) | 1826.91 (1) | 0.0 (0) |
| lisbon-wedding | 24 | 0.0 (0) | 0.0 (0) | 0.0 (0) | 0.0 (0) | 362.96 (8) | 1107.43 (8) | 1108.57 (6) | 704.16 (7) | 0.0 (0) | 701.25 (7) | 1797.7 (1) | 0.0 (0) | 0.0 (0) |
| metro | 30 | 146.92 (29) | 128.78 (29) | 66.56 (30) | 83.93 (30) | 49.7 (30) | 171.7 (30) | 91.63 (29) | 118.07 (30) | 373.37 (24) | 118.31 (30) | 160.56 (29) | 57.15 (30) | 1203.22 (19) |
| miplib | 12 | 147.32 (5) | 194.84 (5) | 21.51 (5) | 27.23 (5) | 82.18 (5) | 59.62 (5) | 53.65 (5) | 106.11 (5) | 5.38 (3) | 106.12 (5) | 700.83 (4) | 396.96 (4) | 125.03 (3) |
| planning | 30 | 0.56 (30) | 0.67 (30) | 2.55 (30) | 1.99 (30) | 0.18 (30) | 0.15 (30) | 0.15 (30) | 0.22 (29) | 3.27 (30) | 0.23 (29) | 1.83 (30) | 6.4 (30) | 235.08 (30) |
| railway-transport | 11 | 120.22 (3) | 120.1 (3) | 467.22 (5) | 459.7 (5) | 75.58 (3) | 482.05 (3) | 101.49 (3) | 443.85 (3) | 143.09 (3) | 448.21 (3) | 465.49 (3) | 859.37 (5) | 0.0 (0) |
| shiftdesign | 22 | 999.39 (12) | 969.07 (12) | 651.17 (20) | 457.29 (14) | 290.83 (22) | 323.05 (22) | 37.85 (22) | 34.71 (22) | 1148.89 (9) | 34.9 (22) | 905.25 (16) | 47.71 (22) | 1497.86 (7) |
| spot5 | 35 | 67.4 (19) | 320.38 (22) | 313.41 (32) | 299.91 (32) | 0.84 (24) | 35.98 (24) | 1.48 (24) | 0.78 (24) | 54.85 (13) | 0.77 (24) | 3.4 (24) | 265.92 (27) | 23.31 (20) |
| staff-scheduling | 12 | 1.87 (1) | 3.64 (1) | 1100.73 (2) | 0.39 (1) | 1030.19 (2) | 1718.81 (2) | 583.14 (2) | 807.59 (2) | 4.55 (1) | 806.21 (2) | 0.46 (1) | 202.3 (2) | 1425.96 (2) |
| timetabling | 35 | 443.63 (21) | 357.89 (21) | 665.23 (23) | 434.9 (26) | 325.57 (23) | 419.83 (24) | 186.04 (24) | 148.46 (24) | 450.31 (19) | 148.34 (24) | 833.03 (17) | 521.78 (15) | 0.0 (0) |
| warehouses | 18 | 0.55 (18) | 0.08 (18) | 628.77 (9) | 590.29 (9) | 7.58 (2) | 1586.78 (4) | 61.25 (6) | 16.0 (9) | 1.04 (18) | 16.05 (9) | 20.46 (3) | 0.14 (1) | 0.09 (18) |
| BTBNSL | 35 | 536.77 (25) | 541.97 (25) | 546.47 (15) | 535.59 (15) | 129.31 (9) | 81.33 (8) | 70.03 (5) | 94.0 (6) | 310.41 (9) | 104.94 (6) | 820.18 (3) | 234.25 (2) | 199.81 (5) |
| causal-discovery | 35 | 295.75 (22) | 298.28 (22) | 728.77 (28) | 933.98 (28) | 700.12 (29) | 852.16 (11) | 547.79 (12) | 466.09 (10) | 826.79 (22) | 514.4 (10) | 1048.4 (5) | 0.0 (0) | 0.0 (0) |
| correlation-clustering | 35 | 616.69 (23) | 452.53 (22) | 1820.55 (2) | 1292.8 (3) | 75.78 (5) | 2032.16 (2) | 111.57 (5) | 49.39 (5) | 410.08 (27) | 136.99 (2) | 1460.64 (3) | 0.0 (0) | 0.0 (0) |
| min-width | 35 | 0.26 (3) | 0.29 (3) | 469.89 (8) | 475.63 (8) | 4.03 (4) | 12.3 (4) | 0.19 (3) | 0.25 (3) | 0.49 (3) | 0.25 (3) | 0.47 (3) | 0.0 (0) | 33.01 (5) |
| relational-inference | 8 | 123.14 (7) | 581.54 (8) | 0.0 (0) | 0.0 (0) | 773.95 (7) | 219.59 (6) | 132.91 (7) | 469.56 (7) | 236.98 (6) | 469.32 (7) | 972.93 (6) | 0.0 (0) | 11.38 (5) |
| abstraction-refinement | 11 | 1236.85 (11) | 1309.36 (10) | 2100.19 (3) | 1819.52 (3) | 886.73 (11) | 156.34 (10) | 202.0 (10) | 1581.84 (8) | 1933.88 (5) | 1580.76 (8) | 1952.54 (3) | 1799.37 (2) | 0.0 (0) |
| frb | 34 | 43.12 (34) | 47.62 (33) | 32.8 (34) | 358.87 (31) | 33.22 (15) | 106.84 (9) | 204.04 (17) | 347.55 (14) | 406.84 (24) | 348.64 (14) | 484.89 (5) | 39.21 (34) | 399.69 (21) |
| css-refactoring | 11 | 331.03 (6) | 301.06 (6) | 222.19 (9) | 203.92 (9) | 10.41 (10) | 20.53 (10) | 8.05 (10) | 6.73 (10) | 19.47 (2) | 6.86 (10) | 393.1 (9) | 240.47 (2) | 858.01 (10) |
| dalculus | 35 | 20.01 (35) | 21.98 (35) | 10.43 (22) | 10.42 (22) | 0.15 (35) | 0.22 (35) | 0.17 (21) | 0.33 (26) | 6.32 (32) | 0.32 (26) | 3.42 (35) | 1.03 (21) | 207.97 (35) |
| mancoosi | 35 | 2.1 (35) | 1.82 (35) | 544.28 (19) | 527.07 (19) | 0.59 (35) | 1.23 (35) | 0.5 (35) | 0.41 (35) | 1.19 (35) | 0.37 (35) | 28.96 (35) | 335.16 (31) | 0.94 (35) |
| packup | 35 | 1.53 (35) | 2.23 (35) | 372.66 (28) | 318.57 (28) | 42.21 (35) | 22.76 (33) | 1.25 (33) | 3.65 (33) | 3.89 (35) | 18.41 (33) | 14.3 (35) | 0.0 (0) | 0.45 (35) |
| Total | 767 | 236.46 (538) | 225.77 (533) | 385.18 (503) | 397.82 (499) | 202.1 (498) | 231.88 (468) | 133.44 (453) | 146.31 (452) | 247.24 (452) | 149.61 (449) | 260.67 (398) | 201.12 (374) | 241.84 (348) |
✝ Non-competitive solver.