# Yearly comparison of Optimization Libraries

**URL:** https://discourse.julialang.org/t/yearly-comparison-of-optimization-libraries/110165
**Category:** Optimization (Mathematical)
**Created:** [February 13, 2024, 5:34pm UTC](https://discourse.julialang.org/t/yearly-comparison-of-optimization-libraries/110165 "2024-02-13T17:34:23Z")
**Posts on this page:** 7
**Page:** 1

<div class="post-metadata">

### Author: ![bdas123](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/bdas123/32/32142_2.png) [@bdas123](https://discourse.julialang.org/u/bdas123)
#### Post date: [February 13, 2024, 5:34pm UTC](https://discourse.julialang.org/t/yearly-comparison-of-optimization-libraries/110165/1 "2024-02-13T17:34:23Z")

</div>

Hello!

Does the Julia community have a yearly contest between different optimization libraries against hidden benchmark problems?

---

<div class="post-metadata">

### Author: ![odow](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/odow/32/28685_2.png) [@odow](https://discourse.julialang.org/u/odow)
#### Post date: [February 13, 2024, 6:48pm UTC](https://discourse.julialang.org/t/yearly-comparison-of-optimization-libraries/110165/2 "2024-02-13T18:48:30Z")

</div>

No.

But you may be interested in:

[https://plato.asu.edu/bench.html](https://plato.asu.edu/bench.html)

> [@AC Optimal Power Flow in Various Nonlinear Optimization Frameworks](https://discourse.julialang.org/t/ac-optimal-power-flow-in-various-nonlinear-optimization-frameworks/78486):
>
> As a follow up to my [NLP modeling survey post](https://discourse.julialang.org/t/survey-of-non-linear-optimization-modeling-layers-in-julia/78168), I am please to announce the release of the [Rosetta OPF](https://github.com/lanl-ansi/rosetta-opf) project. The goal of this project is to highlight the basic technical requirements for solving the kinds of continuous non-convex mathematical optimization problems that I regularly encounter. To that end, Rosetta OPF provides example implementations of the AC Optimal Power Flow (AC-OPF) problem in five of Julia’s nonlinear optimization modeling layers. Based on the findings of the NLP modeling …

---

<div class="post-metadata">

### Author: ![bdas123](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/bdas123/32/32142_2.png) [@bdas123](https://discourse.julialang.org/u/bdas123)
#### Post date: [February 13, 2024, 7:15pm UTC](https://discourse.julialang.org/t/yearly-comparison-of-optimization-libraries/110165/3 "2024-02-13T19:15:51Z")

</div>

Hmmm…

Would this be of interest to the Julia community?

---

<div class="post-metadata">

### Author: ![odow](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/odow/32/28685_2.png) [@odow](https://discourse.julialang.org/u/odow)
#### Post date: [February 13, 2024, 7:20pm UTC](https://discourse.julialang.org/t/yearly-comparison-of-optimization-libraries/110165/4 "2024-02-13T19:20:36Z")

</div>

What optimization libraries? Modeling languages? Solvers? Solvers with different parameter choices?

Doing this well is time consuming and difficult. How would you choose the hidden problems?

You might consider instead contributing to [SciMLBenchmarks.jl: Benchmarks for Scientific Machine Learning (SciML) and Equation Solvers · The SciML Benchmarks](https://docs.sciml.ai/SciMLBenchmarksOutput/stable/)

---

<div class="post-metadata">

### Author: ![tbeason](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/tbeason/32/15898_2.png) [@tbeason](https://discourse.julialang.org/u/tbeason)
#### Post date: [February 13, 2024, 7:28pm UTC](https://discourse.julialang.org/t/yearly-comparison-of-optimization-libraries/110165/5 "2024-02-13T19:28:21Z")

</div>

I think something like the Mittelmann benchmarks in Julia for popular solvers and optimization packages would be quite useful and quite distinct from the DiffEq-focused SciML benchmarks.

---

<div class="post-metadata">

### Author: ![ChrisRackauckas](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/chrisrackauckas/32/77_2.png) [@ChrisRackauckas](https://discourse.julialang.org/u/ChrisRackauckas)
#### Post date: [February 13, 2024, 10:08pm UTC](https://discourse.julialang.org/t/yearly-comparison-of-optimization-libraries/110165/6 "2024-02-13T22:08:40Z")

</div>

I don’t plan to setup things for things like linear programming, mixed integer linear programming, etc., but if there’s a PR to the benchmarks repo we’d be happy to have it use the machines and help maintain it.

---

<div class="post-metadata">

### Author: ![gdalle](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/gdalle/32/27854_2.png) [@gdalle](https://discourse.julialang.org/u/gdalle)
#### Post date: [May 23, 2024, 11:59am UTC](https://discourse.julialang.org/t/yearly-comparison-of-optimization-libraries/110165/7 "2024-05-23T11:59:46Z")

</div>

Related:

- [One stop shop for benchmark optimization problems?](https://discourse.julialang.org/t/one-stop-shop-for-benchmark-optimization-problems/6257)
- [ANN: SolverBenchmark.jl](https://discourse.julialang.org/t/ann-solverbenchmark-jl/21643)
- [ANN: NLPModels.jl v0.1.0](https://discourse.julialang.org/t/ann-nlpmodels-jl-v0-1-0/1795)
