« A first look at OscaR (Scala in OR), former Scampi | Main | CP2013 (Constraint Programming Conference) will be held in Uppsala, 16 - 20 September 2013 »

Results MiniZinc Challenge 2012

The result from MiniZinc Challenge 2012 was presented this Friday (the last day of CP2012, 18th International Conference on Principles and Practice of Constraint Programming ).

The official contestants (solvers) this year was: Of these solvers, the only one I haven't tested (yet) is izplus.

Official results

The official results are:
  • Fixed search:
    • Gold medal: Gecode
    • Silver medal: Jacop
    • Bronze medal: OR-Tools
  • Free search:
    • Gold medal: Gecode
    • Silver medal: Fzn2smt
    • Bronze medal: izplus
  • Parallel search:
    • Gold medal: Gecode
    • Silver medal: Fzn2smt
    • Bronze medal: izplus
Congratutations to all!

Result including all solvers

It can be interesting to see the results for all solvers in the Challenge, including the G12's internal solvers such as Chuffed and CPX (which "are not eligible for prizes, but do modify the scoring results"). For a short description of these non-eligible solvers, see the short description at the result page.

I took the results from the "Selection" section of the result page and for each categories selected "Select all problems", "Compute results" and then sorted on the points (most is best). The result is quite interesting since it shows that Chuffed and G12 CPX got most points in all the three categories, and G12 Lazy FD also got good places.

Note: The mixing in the categories is explained by the management: entries in the FD search category were automatically included in the free search category, while entries in the free search category (including promoted FD entries) were automatically included in the parallel search category. The official winners (gold, silver, bronze) has been embolded.
  • Fixed search ("FD category solvers")
    chuffed-fd1136
    g12_cpx-fd1060
    gecode-fd881
    g12_lazyfd-fd783
    jacop-fd548
    g12_fd-fd525
    or_tools-fd488
    choco-fd430
    bprolog-fd265

  • Free category ("Free category solvers")
    chuffed-free2359
    g12_cpx-free1915
    g12_lazyfd-free1782
    gecode-free1620
    fzn2smt-free1522
    gurobi-free1481
    izplus-free1413
    cplex-free1367
    jacop-free1326
    bprolog-free1203
    mistral-free1199
    g12_fd-free998
    choco-free805
    or_tools-free692
    minisatid-free648
    cbc-free222

  • Par category ("Par category solvers")
    chuffed-free2341
    g12_cpx-free1897
    gecode-par1846
    g12_lazyfd-free1758
    fzn2smt-free1504
    gurobi-par1499
    izplus-free1380
    cplex-par1351
    jacop-free1293
    bprolog-free1178
    mistral-free1173
    g12_fd-free974
    or_tools-par810
    choco-free789
    minisatid-free627
    cbc-free222

Note that all the problem instances are available for download from the Result page (mznc12-problems.tar.gz).

Also see: MiniZinc Challenge Medals 2008-2012