# JuliaUserGroupMunich: Share&Code on ReinforcementLearning.jl with Jun Tian

**URL:** <https://discourse.julialang.org/t/juliausergroupmunich-share-code-on-reinforcementlearning-jl-with-jun-tian/79418>\
**Category:** Meetups\
**Tags:** announcement\
**Created:** [April 13, 2022, 7:37am UTC](https://discourse.julialang.org/t/juliausergroupmunich-share-code-on-reinforcementlearning-jl-with-jun-tian/79418 "2022-04-13T07:37:22Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![schlichtanders](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/schlichtanders/32/32145_2.png) [@schlichtanders](https://discourse.julialang.org/u/schlichtanders)\
**Post date:** [April 13, 2022, 7:37am UTC](https://discourse.julialang.org/t/juliausergroupmunich-share-code-on-reinforcementlearning-jl-with-jun-tian/79418/1 "2022-04-13T07:37:22Z")

</div>

Join us 🗓 Monday 02. May 2022 🕡 16:00 CEST.

A Practical Introduction to ReinforcementLearning.jl  
▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔  
I am glad to welcome Jun Tian @findmyway as our speaker, who will be joining remotely from Beijing. Because of 6 hours difference in timezone we start earlier this time.

Jun Tian is the main developer and maintainer of [ReinforcementLearning.jl](https://github.com/JuliaReinforcementLearning/ReinforcementLearning.jl). He will give an introduction to the ecosystem and can also answer all your deep question.

The level will be a mixture of beginner & intermediate.

┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉AGENDA┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉  
🕡 16:00 - 17:30: Jun Tian: A Practical Introduction to ReinforcementLearning.jl

Reinforcement learning has led to many breakthroughs in recent years.  
In this talk, Jun Tian will give a short introduction on how to use  
ReinforcementLearning.jl to solve some interesting problems. After  
this talk, users will be able to apply modern deep reinforcement  
learning algorithms to the problems they are interested in.

🕘 17:30 - 18:00: Time for further discussion  
┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉┉

The event is going to be online. The link will be made available 10 min before the actual start. Please join 5 min ahead, the session is going to start on-time,  
🗓 Monday 02. May 2022 🕡 16:00 CEST.

Looking forward to see you all,

best,  
Stephan Sahm

sponsored by [Jolin.io](http://Jolin.io)

> **[jolin.io](https://www.jolin.io)**
>
> Build performant data pipelines & machine learning powered by the Julia programming language.

---

<div class="post-metadata">

**Author:** ![schlichtanders](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/schlichtanders/32/32145_2.png) [@schlichtanders](https://discourse.julialang.org/u/schlichtanders)\
**Post date:** [May 2, 2022, 7:35am UTC](https://discourse.julialang.org/t/juliausergroupmunich-share-code-on-reinforcementlearning-jl-with-jun-tian/79418/2 "2022-05-02T07:35:13Z")

</div>

Hi Julia fans,

looking forward to our meetup today about ReinforcementLearning.jl with its maintainer Jun Tian - live from Beijing.

Remember we start earlier today, already at 16:00 CEST.  
The link will also be posted here.

See you later,  
best,  
Stephan Sahm

---

<div class="post-metadata">

**Author:** ![schlichtanders](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/schlichtanders/32/32145_2.png) [@schlichtanders](https://discourse.julialang.org/u/schlichtanders)\
**Post date:** [May 2, 2022, 1:48pm UTC](https://discourse.julialang.org/t/juliausergroupmunich-share-code-on-reinforcementlearning-jl-with-jun-tian/79418/3 "2022-05-02T13:48:50Z")

</div>

We are online.

Here is the link to the event:

> **[Join conversation](https://teams.microsoft.com/dl/launcher/launcher.html?url=%2F_%23%2Fl%2Fmeetup-join%2F19%3Ameeting_ODVhZjUzYTctNGJjNy00M2ZjLWJiZGQtZTE5NDE1NDM0ZjE1%40thread.v2%2F0%3Fcontext%3D%257B%2522Tid%2522%253A%2522353fe535-14d8-46ab-82dd-442d976079e4%2522%252C%2522Oid%2522%253A%2522217553d9-8b46-4e88-8455-f18457998297%2522%252C%2522MessageId%2522%253A%25220%2522%257D%26anon%3Dtrue&type=meetup-join&deeplinkId=21344188-a7f5-4de3-af71-4a519d534105&directDl=true&msLaunch=true&enableMobilePage=true)**

---

<div class="post-metadata">

**Author:** ![j\_u](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/j_u/32/219081_2.png) [@j\_u](https://discourse.julialang.org/u/j_u)\
**Post date:** [May 3, 2022, 12:28am UTC](https://discourse.julialang.org/t/juliausergroupmunich-share-code-on-reinforcementlearning-jl-with-jun-tian/79418/4 "2022-05-03T00:28:22Z")

</div>

Thank you for this meetup. As always great organization. Very interesting topic and presentation. @schlichtanders Would you please pass the following question to the presenter: “Would you please consider organizing something like an online minisymposium on RL in a foreseeable future: (ReinforcementLearning.jl, AlphaZero.jl, POMDPs.jl …)”

---

<div class="post-metadata">

**Author:** ![schlichtanders](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/schlichtanders/32/32145_2.png) [@schlichtanders](https://discourse.julialang.org/u/schlichtanders)\
**Post date:** [May 4, 2022, 12:41pm UTC](https://discourse.julialang.org/t/juliausergroupmunich-share-code-on-reinforcementlearning-jl-with-jun-tian/79418/5 "2022-05-04T12:41:40Z")

</div>

The recording is ready and uploaded to youtube. Enjoy

[![](https://global.discourse-cdn.com/julialang/original/3X/a/4/a40fb99bb978a92efdb45e6521e4ed56a3e7d235.jpeg "ReinforcementLearning jl | Jun Tian | Julia User Group Munich - Share&Code") ](https://www.youtube.com/watch?v=ckIIxKM14Ow)

Any thoughts about the reinforcement minisymposium suggestion @findmyway?

---

<div class="post-metadata">

**Author:** ![j\_u](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/j_u/32/219081_2.png) [@j\_u](https://discourse.julialang.org/u/j_u)\
**Post date:** [May 4, 2022, 1:14pm UTC](https://discourse.julialang.org/t/juliausergroupmunich-share-code-on-reinforcementlearning-jl-with-jun-tian/79418/6 "2022-05-04T13:14:15Z")

</div>

> [@schlichtanders](#):
>
> Any thoughts about the reinforcement minisymposium suggestion @findmyway?

I am very sorry, I was not aware of this Julia Discourse feature to find a person by a real name. Thank you @schlichtanders for rising this topic and many thanks to @findmyway for such interesting presentation. (This is written with a smile.) I would like to add that in my opinion minisymposium on reinforcement learning would speed up the development of activities of this particular area of Julia Community, which I believe is at the forefront and is one of the most interesting fields of scientific developments currently taking place, with many real world applications.

---

<div class="post-metadata">

**Author:** ![findmyway](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/findmyway/32/4946_2.png) [@findmyway](https://discourse.julialang.org/u/findmyway)\
**Post date:** [May 4, 2022, 5:47pm UTC](https://discourse.julialang.org/t/juliausergroupmunich-share-code-on-reinforcementlearning-jl-with-jun-tian/79418/7 "2022-05-04T17:47:43Z")

</div>

> “Would you please consider organizing something like an online minisymposium on RL in a foreseeable future: (ReinforcementLearning.jl, AlphaZero.jl, POMDPs.jl …)”

There were some attempts:

- @zsunberg prepared a BoF at JuliaCon last year. [RL/Sequential Decision Making Birds of Feather session at JuliaCon 2021 · JuliaReinforcementLearning/ReinforcementLearning.jl · Discussion #220 · GitHub](https://github.com/JuliaReinforcementLearning/ReinforcementLearning.jl/discussions/220)
- I talked with @jonathan-laurent last summer on some potential directions to integrate RL.jl and AZ.jl. I think our conclusion at that time was that except for the environments part we only have very few components to share with each other. But we reached an agreement that we do need some better tools for distributed computing in RL specific fields. And that’s the main motivation of [OpenTelemetry.jl](https://github.com/oolong-dev/OpenTelemetry.jl).

Although these packages are all RL specific and have some overlap, I think we are all exploring very different directions. For me, I’m trying to split out some common components into independent packages that may be useful for others, like [CircularArrayBuffer.jl](https://github.com/JuliaReinforcementLearning/CircularArrayBuffers.jl), or [Trajectories.jl](https://github.com/JuliaReinforcementLearning/Trajectories.jl). So that others can reuse them to implement very different algorithms.

> I would like to add that in my opinion minisymposium on reinforcement learning would speed up the development of activities of this particular area of Julia Community, which I believe is at the forefront and is one of the most interesting fields of scientific developments currently taking place, with many real world applications.

I totally agree. Like I said in the talk, I think I will be more well-prepared for such mini-symposium after this summer once I finish the next release of RL.jl (it’s been more than half a year since the last release). And hopefully, I can share some industry-level experiences on RL at that time.

---

<div class="post-metadata">

**Author:** ![j\_u](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/j_u/32/219081_2.png) [@j\_u](https://discourse.julialang.org/u/j_u)\
**Post date:** [May 4, 2022, 7:49pm UTC](https://discourse.julialang.org/t/juliausergroupmunich-share-code-on-reinforcementlearning-jl-with-jun-tian/79418/8 "2022-05-04T19:49:46Z")

</div>

I understand. Although my experience so far is mostly related to AlphaZero.jl, I will look forward with anticipation for the next release of RL.jl. I will also take a closer look into OpenTelemetry.jl and its implementation prepared by the author of AlphaZero.jl, especially that 1.8 might be close to RC and AFAIK should bring significant improvments related to BLAS. To refer to your presentation, I do hope that the OpenTelemetry could be one of the ways leading to unification of the resources. I also do fully agree with you that there is not that great overlap, on the other hand it seems that there is a significant potential for cooperation. I’d like to say thank you once again and I do hope that the topic of reinforcement learning shows up on the agenda of JuliaUserGroupMunich one more time (hopefully more then once) in the future.