# How do use Hyperopt.jl's Bayesian Hyperparameter Optimization feature?

**URL:** <https://discourse.julialang.org/t/how-do-use-hyperopt-jls-bayesian-hyperparameter-optimization-feature/64447>\
**Category:** General Usage\
**Created:** [July 11, 2021, 2:25am UTC](https://discourse.julialang.org/t/how-do-use-hyperopt-jls-bayesian-hyperparameter-optimization-feature/64447 "2021-07-11T02:25:08Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![xiaodai](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/xiaodai/32/15937_2.png) [@xiaodai](https://discourse.julialang.org/u/xiaodai)\
**Post date:** [July 11, 2021, 2:25am UTC](https://discourse.julialang.org/t/how-do-use-hyperopt-jls-bayesian-hyperparameter-optimization-feature/64447/1 "2021-07-11T02:25:08Z")

</div>

The package says it has Bayesian Optimization but I can’t find much info on how to use it.

> **[GitHub - baggepinnen/Hyperopt.jl: Hyperparameter optimization in Julia.](https://github.com/baggepinnen/Hyperopt.jl)**
>
> Hyperparameter optimization in Julia. Contribute to baggepinnen/Hyperopt.jl development by creating an account on GitHub.

Does it go by some other name?

---

<div class="post-metadata">

**Author:** ![mohamed82008](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/mohamed82008/32/18171_2.png) [@mohamed82008](https://discourse.julialang.org/u/mohamed82008)\
**Post date:** [July 11, 2021, 5:15am UTC](https://discourse.julialang.org/t/how-do-use-hyperopt-jls-bayesian-hyperparameter-optimization-feature/64447/2 "2021-07-11T05:15:25Z")

</div>

The package is undergoing refactoring now. CC: @baggepinnen

---

<div class="post-metadata">

**Author:** ![baggepinnen](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/baggepinnen/32/693_2.png) [@baggepinnen](https://discourse.julialang.org/u/baggepinnen)\
**Post date:** [July 11, 2021, 6:18am UTC](https://discourse.julialang.org/t/how-do-use-hyperopt-jls-bayesian-hyperparameter-optimization-feature/64447/3 "2021-07-11T06:18:18Z")

</div>

> [@mohamed82008](#):
>
> The package is undergoing refactoring now

That’s correct. The old GPSampler has been removed in a recent commit, and a new BOHB sampler will be added by merging

> <https://github.com/baggepinnen/Hyperopt.jl/pull/54>
>
> BOHB implementation

once I’m back in office.

The GPSampler was removed since it never worked very well. Bayesian optimization itself requires a lot of carefully tuned hyperparameters to work, and Hyperopt tried to pick some clever defaults. In practice it was very brittle and hard to understand why it did or didn’t work. It also required a lot of effort to maintain.

A new release with release notes will be out once all BOHB has landed and I’ve played around a bit with it.

---

<div class="post-metadata">

**Author:** ![xiaodai](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/xiaodai/32/15937_2.png) [@xiaodai](https://discourse.julialang.org/u/xiaodai)\
**Post date:** [July 11, 2021, 6:19am UTC](https://discourse.julialang.org/t/how-do-use-hyperopt-jls-bayesian-hyperparameter-optimization-feature/64447/4 "2021-07-11T06:19:21Z")

</div>

Ok. BO means so many things to ppl. Like there is the TPE etc.