# Library to track performance over time

**URL:** <https://discourse.julialang.org/t/library-to-track-performance-over-time/92656>\
**Category:** General Usage\
**Created:** [January 8, 2023, 4:00am UTC](https://discourse.julialang.org/t/library-to-track-performance-over-time/92656 "2023-01-08T04:00:49Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![cstjean](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/cstjean/32/1444_2.png) [@cstjean](https://discourse.julialang.org/u/cstjean)\
**Post date:** [January 8, 2023, 4:00am UTC](https://discourse.julialang.org/t/library-to-track-performance-over-time/92656/1 "2023-01-08T04:00:49Z")

</div>

I’m often interested in tracking certain metrics’ evolution over time (eg. performance on some benchmark task, model accuracy, time-to-first-plot, testing time, etc.) Is there a library that helps with these things? I know that I can do it myself (write some JSON to a file each time the benchmark is run), but if it’s already nicely packaged, I’d rather use something else.

---

<div class="post-metadata">

**Author:** ![giordano](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/giordano/32/2166_2.png) [@giordano](https://discourse.julialang.org/u/giordano)\
**Post date:** [January 8, 2023, 5:24am UTC](https://discourse.julialang.org/t/library-to-track-performance-over-time/92656/2 "2023-01-08T05:24:37Z")

</div>

[GitHub - JuliaCI/PkgBenchmark.jl: Easy benchmark tracking for packages](https://github.com/JuliaCI/PkgBenchmark.jl) may help

---

<div class="post-metadata">

**Author:** ![cstjean](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/cstjean/32/1444_2.png) [@cstjean](https://discourse.julialang.org/u/cstjean)\
**Post date:** [January 8, 2023, 2:09pm UTC](https://discourse.julialang.org/t/library-to-track-performance-over-time/92656/3 "2023-01-08T14:09:45Z")

</div>

Neat! But I’m more looking into a year-long timeseries plot showing how, say, `train_set_error(...)` has decreased over time.

---

<div class="post-metadata">

**Author:** ![jules](https://avatars.discourse-cdn.com/v4/letter/j/41988e/32.png) [@jules](https://discourse.julialang.org/u/jules)\
**Post date:** [January 8, 2023, 5:25pm UTC](https://discourse.julialang.org/t/library-to-track-performance-over-time/92656/4 "2023-01-08T17:25:15Z")

</div>

I haven’t continued developing it, but I had started something for that purpose here [GitHub - jkrumbiegel/VersionBenchmarks.jl](https://github.com/jkrumbiegel/VersionBenchmarks.jl/)

It was functional but not completely well thought out last I used it.