# Reactant + Lux LLama on TPUs

**URL:** <https://discourse.julialang.org/t/reactant-lux-llama-on-tpus/131492>\
**Category:** General Usage\
**Tags:** lux, colab, reactant\
**Created:** [August 9, 2025, 3:03pm UTC](https://discourse.julialang.org/t/reactant-lux-llama-on-tpus/131492 "2025-08-09T15:03:53Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![yolhan\_mannes](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/yolhan_mannes/32/220485_2.png) [@yolhan\_mannes](https://discourse.julialang.org/u/yolhan_mannes)\
**Post date:** [August 9, 2025, 3:03pm UTC](https://discourse.julialang.org/t/reactant-lux-llama-on-tpus/131492/1 "2025-08-09T15:03:53Z")

</div>

Just wanted to share how to use Reactant+Lux on TPUs for a LLama like transformer model, it seems really nice to write even though its hard to adapt to the compact way of writting it does feel a lot better after. Still cannot take gradients though but this may be known.

> **[Google Colab](https://colab.research.google.com/drive/1WZe32wtgjb9fKWrymjehYUfoMct7IaTu?usp=sharing)**

Didn’t try to mesh the devices yet but it may be even better after