ROADEF'2009 Challenge Results
The following table presents the final ranking obtained using the average normalized score, computed as follows. Let z(M,I) denote the objective function value obtained by Method M on Instance I. Let zb(I) and zw(I) denote the best and worst objective function values found on instance I, respectively. The normalized score obtained by Method M on Instance I is given by (zw(I)-z(M,I))/(zw(I)-zb(I)). If a method does not provide a solution or if the returned solution is infeasible,
its score is set to two times zw(I). The average score is computed using instances B01,…,B10 and instances XA1,…,XB4 (see tables below). The qualified teams that did not send any program for the final phase where not ranked. The winners of categories Senior and Junior are displayed in bold. Congratulations to them!
| Team |
Category |
Global rank (category rank) |
Average score (%) |
| Bisaillon, Cordeau, Laporte, Pasin | Senior | 1(1) | 95,90
|
| Hanafi, Wilbaut, Mansi, Clautiaux | Senior | 2(2) | 92,73
|
| Acuna-Agost, Michelon, Feillet, Gueye | Senior | 3(3) | 74,26 |
| Eggermont, Firat, Hurkens, Modelski | Junior | 4(1) | 72,01 |
| Darlay, Kronek, Schrenk, Zaourar | Junior | 5(2) | 70,62 |
| Peekstok, Kuipers | Senior | 6(4) | 70,31 |
| Jozefowiez, Mancel, Mora-Camino | Senior | 7(5) | 64,02 |
| Dickson, Smith, Li | Junior | 8(3) | 42,02
|
| Eggenberg, Salani | Junior | 9(4) | 20,48
|
The table below presents detailed results on "B" instances, giving for each instance the obtained objective value.
The best solution is displayed in bold. INF means that the solution is infeasible of that no solution has been returned in 600 seconds. In this case the obtained score is indicated in row INF.
| Equipe |
B01 |
B02 |
B03 |
B04 |
B05 |
B06 |
B07 |
B08 |
B09 |
B10 |
| Bisaillon, Cordeau, Laporte, Pasin | 983731,75 | 1522452.75 | 1031825.30 | 1192519.20 | 15639190.80 | 3789254.05 |
5488693.00 | 4069557.35 | 5906239.15 | 52355192.80 |
| Hanafi, Wilbaut, Mansi, Clautiaux | 5813896.95 | 9950888.70
| 5569623.95
| 5775277.70
| 13139974.30
| 9095248.10
| 19144460.30
| 10099607.00
| 10176173.55
| 34523605.00
|
| Acuna-Agost, Michelon, Feillet, Gueye | 1540123.55
| 2656393.25
| 1572754.95
| 1629491.90
| 14042563.85
| 4926204.05
| 8381142.30
| 5092952.60
| 5414178.30
| 40080949.40
|
| Eggermont, Firat, Hurkens, Modelski | 3217796.25
| 4461933.95
| 3271881.70
| 3543256.85
| 31672882.38
| 8551295.95
| 13986055.45
| 8497737.40
| 9801201.70
| 79360538.12
|
| Darlay, Kronek, Schrenk, Zaourar | 2536224.55
| 6606995.30
| 2608230.65
| 2579266.05
| 23851090.70
| 9464384.25
| 15325407.75
| 9116067.25
| 11028794.15
| 52379928.90
|
| Peekstok, Kuipers | 1590791.95
| 2482349.85
| 1650348.50
| 1667929.00
| 9653780.05
| 5993131.95
| 8580429.20
| 6234247.00
| 5465108.55
| 38537692.15
|
| Jozefowiez, Mancel, Mora-Camino | 971182.50
| 1220708.30
| 1007565.70
| 1101394.80
| 25302036.95
| 3218000.10
| 5039744.20
| 3509318.00
| 3967344.70
| 59289841.80
|
| Dickson, Smith, Li | 9963882.35
| 15710470.60
| 9972001.35
| 9740290.50
| 50600941.50
| 19611307.00
| 28392630.90
| 17341482.60
| 20636676.85
| 77266518.80
|
| Eggenberg, Salani | 43169547.75
| INF | 47509155.15
| 46400734.65
| 94278109.15
| 66101253.95
| INF | 62391786.00
| 68668311.00
| 124900519.50
|
| INF | - | 31420941.20
| - | - | - | - | 56785261.80
| - | - | - |
The table below presents detailed results on "X" instances, which remained unknown for all participants until the end of the challenge. Instances XA01 to XA04 are similar to "A" instances while instances XB01 to XB04 are similar to "B" instances.
Instances X01 to X04 are large instances that were not included in the evaluation set.
| Equipe |
XA01 |
XA02 |
XA03 |
XA04 |
XB01 |
XB02 |
XB03 |
XB04 |
X01 |
X02 |
X03 |
X04 |
| Bisaillon, Cordeau, Laporte, Pasin | 462571.10
| 2238311.75
| 959080.90
| 5480962.75
| 1352823.05
| 17064421.50
| 6463354.30
| 53543381.45
| 1116142.85
| 806011.20
| 2682125.00
| 485904.75
|
| Hanafi, Wilbaut, Mansi, Clautiaux | 116195.20
| 1475322.10
| 285287.05
| 4112262.60
| 5985772.05
| 12716512.00
| 11124244.55
| 34331225.80
| INF | INF | INF | INF |
| Acuna-Agost, Michelon, Feillet, Gueye | 214321.95
| 2010576.25
| 433172.00
| 6575537.15
| INF | INF | INF | INF | INF | INF | INF | INF |
| Eggermont, Firat, Hurkens, Modelski | 668551.40
| 5046206.95
| 1296361.80
| 6968582.90
| 3435588.65
| INF | INF | INF | INF | INF | INF | INF |
| Darlay, Kronek, Schrenk, Zaourar | 264756.30
| INF | 604065.45
| INF |
3300123.35
| 23798066.00 | INF | INF | INF | INF | INF | INF |
| Peekstok, Kuipers | 145591.00
| 2614075.45
| INF | INF | INF | 11297822.20
| INF | INF | INF | INF | INF | INF |
| Jozefowiez, Mancel, Mora-Camino | 150857.60
| INF | 404964.20
| INF | INF | INF | INF | INF | INF | INF | INF | INF |
| Dickson, Smith, Li | INF | INF | INF | INF | INF | 48707651.85
| INF | INF | INF | INF | INF | INF |
| Eggenberg, Salani | 3743311.35
| 19156807.65
| 5046151.00
| INF | 52947166.05
| 100140971.75
| 67931981.80
| 120051351.40
| INF | INF | INF | INF |
| INF | 7486622.70
| 38313615.30
| 10092302.00
| 13937165.80
| 105894332.10
| 200281943.50
| 135863963.60
| 240102702.80
| 2232285.70
| 1612022.40
| 5364250.00
| 971809.50
|
