Ranking method and some comments about prizes

The final ranking was obtained using the average normalized score, computed as follows. Let z(M,I) denote the objective function value obtained by Method M on Instance I. Let zb(I) and zw(I) denote the best and worst objective function values found on instance I, respectively. The normalized score obtained by Method M on Instance I is given by (z(M,I)-zb(I))/zb(I). If a method does not provide a solution or if the returned solution is infeasible, its score is set to two times zw(I). The average score is computed using instances B6,…,B10 and instances X11,…,X15 (see tables below). The qualified teams that did not send any program for the final phase where not ranked.

For the first time in this challenge, the first three in the senior category did not obtain any best solution over all instances. However their method is able to solve all instances. Congratulations to the first junior team who is also ranked 2nd in the senior category. On the other hand, no multithread method could obtain better results than the best single thread one. Consequently, the jury decided to cancel this prize and offered instead a special prize to the team that obtained the largest number of best solutions (here 6 out of 10). Download the result presentation by EDF.

Senior category

  • Winner : S21 David Savourey,  Vincent Jost, Christoph Dürr,  Nora Touati, Antoine Jeanjean, Polytechnique et Bouygues e-lab, France (4000€ prize)
  • 2nd : J08 Roman Steiner, Sandro Pirkwieser, Matthias Prandtstetter, Vienna University of Technology, Austria
  • 3rd : S14 Julien Darlay, Louis Esperet, Yann Kieffer, Guyslain Naves, Valentin Weber, Laboratoire G-SCOP, France and McGill University, Canada

Junior Category

  • Winner : J08 Roman Steiner, Sandro Pirkwieser, Matthias Prandtstetter, Vienna University of Technology, Austria (2500€ prize)
  • 2nd : J06 Steffen Elberg Godskesen, Thomas Sejr Jensen, Niels Kjeldsen, Rune Larsen, Dept. of Mathematics and Computer Science, Univ. of Southern Denmark and DONG Energy A/S, Denmark (1000€ prize)
  • 3rd: J05 Lauri Ahlroth, Henri Tokola, Andre Schumacher, Aalto Univ., School of Science and Technology, Finland (500€ prize)

Prix spécial du jury

  • S24 Johan Peekstok, Eelco Kuipers, BeImproved, Nederlands (6 best solutions, 2000€ prize).

General Ranking

 
rank id names score score/10 solved B and X instances
1 S21 Christoph Dürr, Antoine Jeanjean, Vincent Jost, David Savourey, Nora Touati 39,211% 3,921% 10
2 J08 Roman Steiner, Sandro Pirkwieser, Matthias Prandtstetter 77,118% 7,712% 10
3 S14 Valentin Weber, Julien Darlay, Guyslain Naves, Yann Kieffer 139,891% 13,989% 10
4 S23MT Laurent Alfandari, Daniel Chemla, Lucas Létocart, Guillaume Turri, Antoine Rozenknop, Roberto Wolfler Calvo 202,364% 20,236% 7
5 S17 François Soumis, Guy Desaulniers, Michel Gendreau, Louis-Martin Rousseau, François Lessard, Vincent Raymond 297,191% 29,719% 9
6 S24 Johan Peekstok, Eelco Kuipers 299,955% 29,996% 9
7 J06 Niels Kjeldsen, Thomas Sejr Jensen, Steffen Elberg Godskesen, Kristian Schmidt 407,501% 40,750% 8
8 S04 Mauro Dell'Amico 486,043% 48,604% 7
9 S22 Frédéric Gardi, Bertrand Estellon, Karim Nouioua 494,288% 49,429% 6
10 S08 Cor Hurkens 495,240% 49,524% 8
11 J05 Lauri Ahlroth, Henri Tokola, Andre Schumacher 574,203% 57,420% 10
12 S23 Laurent Alfandari, Daniel Chemla, Lucas Létocart, Guillaume Turri, Antoine Rozenknop, Roberto Wolfler Calvo 624,030% 62,403% 5
13 S16 Hadrien Cambazard, Emmanuel Hebrard 773,511% 77,351% 5
14 S10 Bjørn Petersen, Laurent Flindt Muller, Richard Martin Lusby 8801,920% 880,192% 9
15 S10MT Bjørn Petersen, Laurent Flindt Muller, Richard Martin Lusby 8961,748% 896,175% 9
16 J16 Stefan Heinz, Ulrich Menne, Thomas Schlechte, Ingo Spiegelberg, Michael Winkler 9330,627% 933,063% 8
17 S11 Win32 Davide Anghinolfi, Cristiano Nattero, Massimo Paolucci, Luca Maria Gambardella, Roberto Montemanni, Nihat Engin Toklu 12029,319% 1202,932% 6
18 S22MT Frédéric Gardi, Bertrand Estellon, Karim Nouioua 17612,274% 1761,227% 3

Detailed results

Team B6 B7 B8 B9 B10 X11 X12 X13 X14 X15
J05 86 212 338 451 83 957 349 585 360 208 437 376 214 930 128 905 95 212 023 758 82 112 862 301 78 771 254 564 79 007 897 528 87 104 725 085 89 678 901 181
J06 85 510 567 568 81 956 124 204 83 512 643 193 83 486 723 923 80 185 155 385 80 272 067 463 78 452 136 301 78 677 545 047 INFEASIBLE INFEASIBLE
J08 86 633 394 011 86 156 056 297 95 805 218 113 101 233 463 629 84 910 622 668 81 370 316 950 79 656 014 647 78 348 699 403 80 097 043 360 78 126 877 316
J16 92 683 606 298 91 454 244 156 TIMEOUT 1 590 688 995 511 87 253 173 696 85 206 047 858 83 865 849 449 TIMEOUT 85 929 586 787 81 194 397 865
S04 89 830 402 469 86 377 315 693 94 736 433 665 103 660 242 207 84 437 926 975 TIMEOUT 82 630 837 365 INFEASIBLE 86 846 026 272 TIMEOUT
S08 INFEASIBLE 95 077 691 578 102 325 174 596 101 929 477 361 109 048 119 161 87 183 293 530 82 636 495 618 91 876 939 678 86 722 648 251 INFEASIBLE
S10 89 588 728 336 135 092 408 393 3 101 653 216 427 3 989 120 690 452 150 681 334 639 93 313 248 333 89 986 333 394 TIMEOUT 111 472 775 268 111 306 338 786
S11 91 324 254 612 86 256 370 811 1 640 528 019 308 MEMORY INFEASIBLE 84 273 021 117 83 338 848 053 MEMORY 84 874 579 458 INFEASIBLE
S14 93 059 529 119 88 868 786 065 92 682 243 720 102 856 782 347 87 612 127 710 87 322 428 100 86 223 119 786 86 270 744 621 89 905 919 166 86 278 541 029
S16 86 297 438 396 INFEASIBLE 153 245 604 373 120 429 751 216 83 326 707 852 INFEASIBLE 79 600 144 393 TIMEOUT TIMEOUT INFEASIBLE
S17 99 641 310 100 101 607 288 202 114 459 639 780 128 088 979 062 104 570 457 350 92 421 004 267 95 545 061 149 TIMEOUT 92 070 432 601 90 522 681 609
S21 86 874 708 346 83 685 896 017 87 091 016 611 86 890 692 761 80 646 113 494 81 594 290 310 78 817 536 335 80 582 039 266 79 439 255 212 76 063 004 169
S22 83 917 017 731 81 222 567 600 82 074 154 002 81750858197 78 023 137 871 INFEASIBLE 77 599 965 359 TIMEOUT ERROR ERROR
S23 84 710 369 098 81 843 898 569 83 011 728 931 83 615 201 669 78 779 243 172 TIMEOUT TIMEOUT INFEASIBLE TIMEOUT TIMEOUT
S24 83424716217 81 290 415 505 81926206073 82 614 959 054 77767024999 79116772289 77 634 131 340 76449207715 76172998633 INFEASIBLE
S10MT 89 671 499 236 135 092 408 393 3 101 653 216 427 3 989 120 690 452 150 681 334 639 103 395 017 022 125 556 619 304 TIMEOUT 111 472 775 268 187 264 705 752
S22MT 83 927 145 348 81174243138 INFEASIBLE INFEASIBLE INFEASIBLE INFEASIBLE 77589910940 TIMEOUT ERROR ERROR
S23MT 84 709 341 172 81 839 081 672 82 977 018 880 83 622 825 242 78 730 244 463 TIMEOUT 78 193 054 033 INFEASIBLE TIMEOUT 75101398439

CRASH: the executable doesn't launch.
ERROR: the executable fails alone after at least few seconds.
MEMORY: An error with the word "memory" in the message.
TIME OUT: the executable still runs after 60 minutes.