# Can Julia implement experiment animations similar to those in OpenAI Gym?

**URL:** <https://discourse.julialang.org/t/can-julia-implement-experiment-animations-similar-to-those-in-openai-gym/99426>\
**Category:** Machine Learning\
**Tags:** question\
**Created:** [May 26, 2023, 6:08am UTC](https://discourse.julialang.org/t/can-julia-implement-experiment-animations-similar-to-those-in-openai-gym/99426 "2023-05-26T06:08:00Z")\
**Posts on this page:** 1\
**Showing post:** 13

<div class="post-metadata">

**Author:** ![greatpet](https://avatars.discourse-cdn.com/v4/letter/g/e495f1/32.png) [@greatpet](https://discourse.julialang.org/u/greatpet)\
**Post date:** [January 28, 2025, 11:39am UTC](https://discourse.julialang.org/t/can-julia-implement-experiment-animations-similar-to-those-in-openai-gym/99426/13 "2025-01-28T11:39:01Z")

</div>

Bumping this old thread which has been useful to me. I took the animation function mentioned here but used a different solver. Here’s my CartPole result:

> [@Reinforcement learning packages for CartPole example with Julia v1.11 or v1.10?](https://discourse.julialang.org/t/reinforcement-learning-packages-for-cartpole-example-with-julia-v1-11-or-v1-10/125261/3):
>
> I got it working. Here’s an animation of a trained agent balancing a pole on a cart, after training with 8000 steps of interactions. The arrow indicates if the agent is pushing the cart to the left or to the right. [anim] I used ReinforcementLearning.jl which provided the CartPole environment. However, most of the NN solvers in this package seem to be broken due to API changes in dependencies, therefore I used the solver in DeepQLearning.jl after converting the CartPole environment to its inte…

---

_[View the full topic](https://discourse.julialang.org/t/can-julia-implement-experiment-animations-similar-to-those-in-openai-gym/99426)._