rhyd SBSRL8 2008-03-23T16:38:19Z 2008-04-15T13:20:09Z 11.6568 12300 15315 990 -330 False False SCORES ACHIEVED BY THE ALGORITHMS (Distance to Feasibility, Soft Cost) RANKS FOR THE 50 RUNS ON THIS INSTANCE AVERAGE RANK ACROSS ALL RUNS AND ALL INSTANCES (10 runs per instance, sorted in ascending order (an 'x' means no result was returned by the algorithm in our experiments)) (NB TIED RANKS ARE THE AVERAGE OF THE ASSOCIATED RANKS) ATSUTA ET AL. CAMBAZARD ET AL. CHIARANDINI ET AL. NOTHEGGER ET AL. MULLER ATSUTA ET AL. CAMBAZARD ET AL. CHIARANDINI ET AL. NOTHEGGER ET AL. MULLER ATSUTA ET AL. CAMBAZARD ET AL. CHIARANDINI ET AL. NOTHEGGER ET AL. MULLER INSTANCE (10 RUNS) DtF Soft Cost DtF Soft Cost DtF Soft Cost DtF Soft Cost DtF Soft Cost 1 BEST 0 61 0 571 0 1482 0 15 0 1861 3 6 19 1 26 24.427083333333332 13.904166666666667 28.339583333333334 29.516666666666666 31.3125 1 0 121 0 689 0 1486 0 29 0 1893 4 7 20 2 27 1 0 708 0 696 0 1609 0 410 0 2054 9 8 21 5 30 OFFICIAL POSITION IN COMPETITION 1 0 927 0 760 0 1676 295 1121 19 1747 12 10 22 44 36 1 0 985 0 821 0 1686 572 1513 20 2298 15 11 23 45 37 2nd 1st 3rd 4th 5th 1 5 2 0 932 0 1705 583 1406 25 1865 32 13 24 46 38 1 5 826 0 934 0 1736 674 1685 26 1639 33 14 25 47 39 1 5 906 0 1056 0 1904 741 1456 31 1824 34 16 28 48 40 1 16 1059 0 1127 0 1916 790 1346 50 2084 35 17 29 49 41 1 WORST 52 881 0 1248 0 2105 800 1731 51 2005 43 18 31 50 42 2 BEST 0 547 0 993 0 1635 0 0 39 2174 5 7 13 1.5 31 2 0 774 0 1229 0 1709 0 0 40 2002 6 8 14 1.5 32 2 5 690 0 1501 0 1763 0 13 57 2120 25 9 15 3.5 36 2 27 1093 0 1505 0 1828 0 13 103 2116 28 10 16 3.5 38 2 30 818 0 1541 0 1842 22 700 105 2421 29 11 17 26 39 2 32 739 0 1590 0 1950 24 715 173 2211 30 12 18 27 40 2 41 676 0 1959 0 1982 389 1146 203 2073 33 19 20 45 41 2 41 1327 0 2209 0 2092 731 1387 281 2340 34 23 21 46 42 2 51 939 x 0 2094 1016 1390 340 2189 35 49.5 22 47 43 2 WORST 77 1243 x 0 2241 1176 1415 378 2372 37 49.5 24 48 44 3 BEST 0 382 0 164 0 288 0 391 0 272 25 1 14 27 9 3 0 390 0 179 0 297 0 475 0 277 26 2 15 33 10 3 0 394 0 198 0 298 0 547 0 281 31 3 16 37 12 3 0 432 0 208 0 369 0 626 0 283 32 4 21.5 41 13 3 0 537 0 235 0 369 0 666 0 304 36 5 21.5 44 17 3 0 573 0 237 0 378 0 751 0 313 38 6 23 46 18 3 0 625 0 239 0 392 0 861 0 328 40 7 28 47 19 3 0 634 0 270 0 393 0 937 0 381 42 8 29.5 48 24 3 0 644 0 278 0 505 0 1020 0 393 43 11 34 49 29.5 3 WORST 0 688 0 365 0 608 0 1052 0 507 45 20 39 50 35 4 BEST 0 529 0 310 0 385 0 239 0 425 24 3 12 1 16 4 0 623 0 327 0 413 0 282 0 469 33 4 13.5 2 21 4 0 640 0 336 0 415 0 368 0 535 36 5 15 6.5 25 4 0 673 0 368 0 437 0 672 0 542 38 6.5 17 37 26 4 0 689 0 370 0 461 0 721 0 563 39 8 19 42 27 4 0 697 0 373 0 465 0 727 0 574 40 9 20 43 29 4 0 718 0 378 0 508 0 798 0 609 41 10 22 47 30 4 0 728 0 382 0 528 0 873 0 613 44 11 23 48 31 4 0 764 0 413 0 572 0 1272 0 628 45 13.5 28 49 34 4 WORST 0 771 0 443 0 618 0 1323 0 639 46 18 32 50 35 5 BEST 0 5 0 5 0 559 0 34 0 8 1.5 1.5 41 26 11 5 0 12 0 6 0 569 0 44 0 8 17 4 42 30 11 5 0 15 0 6 0 603 0 66 0 9 18.5 4 43 33 13.5 5 0 16 0 6 0 626 0 67 0 10 20 4 44 34 15 5 0 17 0 7 0 668 0 95 0 11 21 7.5 45 35 16 5 0 18 0 7 0 693 0 133 0 15 22 7.5 46 36 18.5 5 0 23 0 7 0 702 0 159 0 26 23 7.5 47 37 25 5 0 24 0 7 0 709 0 213 0 35 24 7.5 48 38 27.5 5 0 35 0 8 0 784 0 225 0 36 27.5 11 49 39 29 5 WORST 0 45 0 9 0 886 0 247 0 51 31 13.5 50 40 32 6 BEST 0 0 0 0 0 851 0 87 0 28 6 6 39 19 16 6 0 0 0 0 0 898 0 130 0 36 6 6 40 25 17 6 0 0 0 0 0 905 0 171 0 109 6 6 41 26 22 6 0 17 0 0 0 915 0 245 0 118 12 6 42 28 23 6 0 21 0 0 0 937 0 271 0 283 14 6 43 29 30 6 0 44 0 0 0 1033 0 304 0 317 18 6 44 31 32 6 0 98 0 0 0 1040 0 674 0 344 20 6 45 37 33 6 0 108 0 0 0 1043 0 676 0 375 21 6 46 38 34 6 0 125 0 20 0 1068 19 731 0 482 24 13 47 49 35 6 WORST 0 232 0 22 0 1084 20 630 0 574 27 15 48 50 36 7 BEST 0 0 0 6 0 10 0 0 0 13 5 13 24 5 25 7 0 5 0 6 0 115 0 0 0 16 10.5 13 35.5 5 26.5 7 0 5 0 7 0 212 0 0 0 16 10.5 15.5 40 5 26.5 7 0 6 0 8 0 346 0 0 0 41 13 20 43 5 29.5 7 0 94 0 8 0 401 0 0 0 41 32 20 44 5 29.5 7 0 95 0 8 0 405 0 0 0 84 33 20 45 5 31 7 0 137 0 8 0 468 0 0 0 98 37 20 46 5 34 7 0 183 0 8 0 479 0 0 0 115 39 20 47 5 35.5 7 0 221 0 8 0 532 0 7 0 170 41 20 48 15.5 38 7 WORST 0 231 0 8 0 573 0 31 0 1242 42 20 49 28 50 8 BEST 0 0 0 0 0 0 0 4 0 6 11.5 11.5 11.5 29.5 31 8 0 0 0 0 0 0 0 50 0 10 11.5 11.5 11.5 39 32 8 0 0 0 0 0 0 0 52 0 12 11.5 11.5 11.5 40 33 8 0 0 0 0 0 1 0 58 0 13 11.5 11.5 24 42.5 34 8 0 0 0 0 0 1 0 67 0 21 11.5 11.5 24 44 35 8 0 0 0 0 0 1 0 87 0 23 11.5 11.5 24 45 36 8 0 0 0 0 0 2 0 88 0 24 11.5 11.5 27 46 37 8 0 0 0 0 0 2 0 93 0 25 11.5 11.5 27 47 38 8 0 0 0 0 0 2 0 139 0 53 11.5 11.5 27 48 41 8 WORST 0 241 0 0 0 4 0 168 0 58 50 11.5 29.5 49 42.5 9 BEST 0 0 0 1560 0 1947 0 0 162 2733 3 7 13 3 32 9 0 0 0 1569 0 1970 0 0 194 2379 3 8 14 3 35 9 0 1 0 1641 0 1983 0 0 207 2666 6 9 15 3 36 9 52 1013 0 1702 0 2044 641 1446 231 2330 27 10 17 42 37 9 54 942 0 1800 0 2065 666 1363 240 2598 28 11 18.5 43 38 9 70 884 0 1846 0 2096 892 1474 257 2193 29 12 20 46 39 9 114 1058 0 1994 0 2122 1068 1621 364 2162 30 16 21 47 40 9 161 1642 0 2065 0 2156 1083 1468 373 2365 31 18.5 22 48 41 9 174 1262 0 2197 0 2269 1141 1754 673 2392 33 23 24 49 44 9 WORST 174 1527 0 2312 0 2352 1352 1679 764 2259 34 25 26 50 45 10 BEST 0 0 0 2163 0 1741 0 0 161 2697 9 24 21 9 33 10 0 0 0 1650 0 1928 0 0 384 2406 9 19 22 9 35 10 0 0 0 1737 0 1973 0 0 434 2122 9 20 23 9 36 10 0 0 x 0 2174 0 0 442 2401 9 47 25 9 37 10 0 0 x 0 2269 0 0 475 2470 9 47 26 9 38 10 0 0 x 0 2307 0 0 594 2231 9 47 27 9 39 10 0 0 x 32 2489 0 0 714 2364 9 47 29 9 40 10 0 0 x 53 2446 0 0 743 2223 9 47 30 9 41 10 23 1045 x 73 2775 0 0 896 2089 28 47 32 9 42 10 WORST 58 1272 x 213 2621 0 1 932 2187 31 47 34 18 43 11 BEST 0 548 0 178 0 240 0 547 0 263 27 1 2 26 8 11 0 579 0 253 0 246 0 617 0 351 28 4 3 29 15 11 0 674 0 257 0 255 0 675 0 435 31 6 5 32 21 11 0 680 0 260 0 311 0 843 0 469 34 7 12 40 24 11 0 706 0 283 0 353 0 854 0 544 35 9 16 41 25 11 0 739 0 289 0 377 0 927 0 660 36 10 17 44 30 11 0 758 0 294 0 423 0 984 0 676 37 11 19.5 45 33 11 0 780 0 344 0 423 0 1086 0 861 38 13.5 19.5 46 42 11 0 813 0 344 0 445 0 1128 0 2034 39 13.5 22 47 49 11 WORST 0 883 0 381 0 453 0 1319 54 1136 43 18 23 48 50 12 BEST 0 869 0 146 0 475 0 32 0 804 25 2 10 1 22 12 0 959 0 256 0 485 0 613 0 828 27 3 11 18 23 12 0 1023 0 268 0 519 0 841 0 1047 28 4 13 24 31 12 0 1029 0 329 0 572 31 1676 0 1124 29 5 15 43 35 12 0 1041 0 342 0 591 57 1411 0 1192 30 6 16 44 38 12 0 1057 0 356 0 595 158 1330 0 1208 32 7 17 46 39 12 0 1098 0 373 0 640 161 1499 0 1308 33 8 19 47 40 12 0 1114 0 415 0 674 210 1730 0 1526 34 9 20 48 41 12 0 1133 0 508 0 698 225 1751 0 1550 36 12 21 49 42 12 WORST 0 1145 0 534 0 915 286 1870 141 2344 37 14 26 50 45 13 BEST 0 0 0 0 0 675 0 166 0 285 3 3 37 15 21 13 0 0 0 0 0 816 0 324 0 316 3 3 39 23 22 13 0 0 0 35 0 888 0 358 0 326 3 7 41 25 24 13 0 3 0 142 0 893 0 361 0 428 6 11 42 26 30 13 0 61 0 158 0 923 0 380 0 435 8 13 43 28 31 13 0 106 0 162 0 929 0 427 0 445 9 14 44 29 32 13 0 116 0 170 0 944 0 526 0 483 10 16 45 35 33 13 0 144 0 199 0 976 0 657 0 493 12 17 46 36 34 13 0 232 0 206 0 1017 18 840 0 696 20 18 47 49 38 13 WORST 0 364 0 211 0 1050 47 747 0 849 27 19 48 50 40 14 BEST 0 0 0 1 0 864 0 0 0 110 4.5 11.5 41 4.5 28 14 0 0 0 1 0 885 0 9 0 185 4.5 11.5 42 21 30 14 0 0 0 1 0 906 0 16 0 231 4.5 11.5 43 22 32 14 0 0 0 1 0 910 0 39 0 240 4.5 11.5 44 24 33 14 0 0 0 2 0 948 0 43 0 302 4.5 16 45 25 34 14 0 0 0 2 0 967 0 61 0 439 4.5 16 46 26 36 14 0 0 0 3 0 1058 0 82 0 460 4.5 18.5 47 27 37 14 0 1 0 3 0 1074 0 122 0 596 11.5 18.5 48 29 38 14 0 1 0 8 0 1082 0 189 0 739 11.5 20 49 31 39 14 WORST 0 2 0 19 0 1141 0 409 0 777 16 23 50 35 40 15 BEST 0 379 0 0 0 0 0 0 0 5 38 6.5 6.5 6.5 14 15 0 382 0 0 0 269 0 0 0 220 39 6.5 19 6.5 17 15 0 417 0 0 0 290 0 0 0 275 40 6.5 22 6.5 21 15 0 424 0 0 0 305 0 0 0 294 41.5 6.5 27.5 6.5 23 15 0 424 0 0 0 311 0 0 0 301 41.5 6.5 29 6.5 24 15 0 467 0 0 0 328 0 2 0 304 46 6.5 32 13 26 15 0 495 0 191 0 340 0 302 0 305 47 15 34 25 27.5 15 0 513 0 216 0 378 0 330 0 314 48 16 37 33 30.5 15 0 545 0 252 0 438 0 348 0 314 49 18 43 35 30.5 15 WORST 0 560 0 272 0 447 0 445 0 350 50 20 45 44 36 16 BEST 0 191 0 2 0 1 0 41 0 132 35.5 3 1 19 26 16 0 209 0 4 0 2 0 75 0 147 38.5 6.5 3 22 29 16 0 223 0 4 0 2 0 79 0 154 42 6.5 3 23 30 16 0 224 0 7 0 3 0 100 0 161 43 9.5 5 24 32 16 0 225 0 11 0 5 0 118 0 184 44 15.5 8 25 33 16 0 250 0 11 0 7 0 139 0 185 46 15.5 9.5 27 34 16 0 252 0 11 0 8 0 145 0 191 47 15.5 11.5 28 35.5 16 0 285 0 11 0 8 0 160 0 202 48 15.5 11.5 31 37 16 0 325 0 46 0 11 0 209 0 212 49 20 15.5 38.5 40 16 WORST 0 334 0 64 0 11 0 246 0 216 50 21 15.5 45 41 17 BEST 0 1 0 0 0 5 0 68 0 72 4.5 1.5 12.5 31 32 17 0 2 0 0 0 5 0 74 0 79 7.5 1.5 12.5 33 35 17 0 3 0 1 0 6 0 77 0 80 10 4.5 14 34 36 17 0 3 0 1 0 7 0 108 0 88 10 4.5 15 39 37 17 0 17 0 1 0 9 0 124 0 108 23 4.5 17.5 42 39 17 0 22 0 2 0 9 0 130 0 108 26 7.5 17.5 45 39 17 0 24 0 3 0 10 0 135 0 121 27 10 19 46 41 17 0 36 0 8 0 11 0 139 0 128 28 16 20 47 43.5 17 0 39 0 15 0 16 0 144 0 128 29 21 22 48 43.5 17 WORST 0 43 0 18 0 20 0 165 0 150 30 24 25 50 49 18 BEST 0 0 0 0 0 3 0 26 0 70 6 6 13 17 21 18 0 0 0 0 0 3 0 76 0 171 6 6 13 22.5 26 18 0 0 0 0 0 59 0 125 0 216 6 6 19 24 28 18 0 3 0 0 0 236 0 279 0 234 13 6 30 31 29 18 0 6 0 0 0 299 0 303 0 285 15 6 33 34 32 18 0 10 0 0 0 348 0 356 0 332 16 6 37 38.5 35 18 0 38 0 0 0 381 0 356 0 334 18 6 42 38.5 36 18 0 128 0 0 0 469 0 358 0 448 25 6 45 40 44 18 0 201 0 65 0 776 0 368 0 521 27 20 48 41 46 18 WORST 6 8 0 76 0 825 0 401 0 532 50 22.5 49 43 47 19 BEST 267 1862 0 1824 0 1868 0 22 197 2268 24 10 11 1 22 19 306 1894 0 2230 0 1872 0 26 238 2328 27 20 12 2 23 19 322 2113 x 0 1995 0 29 271 2626 28 46.5 13 3 25 19 323 1679 x 0 2008 0 36 274 2285 29 46.5 14 4.5 26 19 330 1778 x 0 2094 0 36 355 2170 30 46.5 15 4.5 32 19 335 1739 x 0 2097 0 41 364 2277 31 46.5 16 6 34 19 360 2054 x 0 2140 0 46 517 2121 33 46.5 17 7 38 19 385 1737 x 0 2147 0 59 611 2507 35 46.5 18 8 39 19 403 1585 x 0 2183 0 99 634 2260 36 46.5 19 9 40 19 WORST 456 1941 x 0 2404 897 1937 4090 2298 37 46.5 21 41 42 20 BEST 0 1215 0 445 0 596 655 2735 0 878 31 1 11 41 21 20 0 1309 0 491 0 597 713 2127 0 911 32 2.5 12 42 22 20 0 1357 0 491 0 608 715 2333 0 915 33 2.5 13 43 23 20 0 1365 0 495 0 612 745 2540 0 918 34 4 14 44 24.5 20 13 1360 0 500 0 613 790 2470 0 918 35 5.5 15 45 24.5 20 17 1249 0 500 0 653 802 2097 0 921 36 5.5 16.5 46 26 20 24 1117 0 521 0 653 806 2294 0 928 37 7 16.5 47 27 20 34 1364 0 530 0 657 815 2638 0 930 38 8 18 48 28 20 37 1269 0 534 0 663 830 2258 0 936 39 9 19 49 29 20 WORST 39 1270 0 543 0 753 841 2336 0 938 40 10 20 50 30 21 BEST 0 0 0 0 0 602 0 33 0 40 5 5 38 17 18 21 0 0 0 0 0 633 0 77 0 116 5 5 39 23 25 21 0 0 0 0 0 697 0 99 0 162 5 5 41 24 27 21 0 0 0 0 0 747 0 157 0 187 5 5 42 26 29 21 0 0 0 9 0 880 0 174 0 258 5 13 43 28 30 21 0 1 0 32 0 894 0 305 0 390 10 16 44 31 32 21 0 2 0 49 0 1001 0 397 0 432 11 19 45 33 34 21 0 4 0 51 0 1034 0 446 0 527 12 20 46 35 36 21 0 12 0 64 0 1137 42 766 0 581 14 21 47 49 37 21 WORST 0 17 0 66 0 1138 101 812 0 675 15 22 48 50 40 22 BEST 0 0 0 29 0 1364 0 0 0 889 6.5 19 32 6.5 27 22 0 0 0 41 0 1566 0 0 0 987 6.5 20 35 6.5 28 22 0 0 0 184 0 1646 0 3 0 1242 6.5 21 36 13 30 22 0 0 0 217 0 1793 0 4 0 1264 6.5 23 37 14.5 31 22 0 0 0 239 0 1884 0 4 0 1515 6.5 24 38 14.5 34 22 0 0 0 349 0 1907 0 6 0 2651 6.5 25 39 16.5 45 22 0 0 0 1033 0 1912 0 6 42 2100 6.5 29 40 16.5 46 22 0 0 0 1475 0 2000 0 7 62 1674 6.5 33 42 18 47 22 0 0 0 1941 0 2029 0 186 102 1714 6.5 41 43 22 48 22 WORST 0 0 x 0 2291 0 611 158 1901 6.5 50 44 26 49 23 BEST 0 430 0 238 0 688 11 1275 0 436 10 1 24 40 11 23 0 474 0 254 0 974 216 1400 0 524 12 2 31 42 14 23 0 491 0 273 0 988 227 1222 0 586 13 3 32 43 17 23 0 532 0 293 0 996 234 1239 0 677 16 4 33 44 23 23 0 616 0 319 0 1010 255 1023 0 720 18 5 34 45 25 23 0 620 0 320 0 1032 259 1425 0 753 19 6 35 46 26 23 0 624 0 329 0 1044 268 1279 0 756 20 7 36 47 27 23 0 642 0 332 0 1122 280 1223 0 770 21 8 37 48 28 23 0 654 0 421 0 1146 322 1258 0 887 22 9 38 49 29 23 WORST 34 656 0 526 0 1434 326 1397 0 904 41 15 39 50 30 24 BEST 0 720 0 21 0 822 0 30 0 372 30 1 32 3 20 24 0 839 0 27 0 857 0 52 0 393 33 2 36 8 21 24 0 843 0 33 0 886 0 77 0 400 34 4 37 10 22 24 0 853 0 40 0 931 0 85 0 499 35 5 38 11 23 24 0 951 0 42 0 948 0 132 0 546 40 6 39 12 24 24 0 965 0 49 0 969 0 137 0 554 41 7 42 13 25 24 0 1054 0 71 0 985 0 146 0 559 46 9 43 14 27 24 4 1068 0 188 0 989 0 152 0 560 48 17 44 15 28 24 58 1115 0 214 0 1047 0 174 0 563 49 18 45 16 29 24 WORST 69 703 0 557 0 1200 0 307 0 734 50 26 47 19 31 600 600 85 12 3 2 19 False False Column J Column K False False False False