# Raspberry Pi AI Kit

**URL:** <https://discourse.julialang.org/t/raspberry-pi-ai-kit/118225>\
**Category:** GPU\
**Tags:** raspberry-pi\
**Created:** [August 15, 2024, 3:19pm UTC](https://discourse.julialang.org/t/raspberry-pi-ai-kit/118225 "2024-08-15T15:19:44Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Vyacheslav\_Vorobyov](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/vyacheslav_vorobyov/32/26301_2.png) [@Vyacheslav\_Vorobyov](https://discourse.julialang.org/u/Vyacheslav_Vorobyov)\
**Post date:** [August 15, 2024, 3:19pm UTC](https://discourse.julialang.org/t/raspberry-pi-ai-kit/118225/1 "2024-08-15T15:19:44Z")

</div>

Hi all!

Does Julia support [Raspberry Pi AI Kit](https://www.raspberrypi.com/products/ai-kit/) ?

Or is it possible to do that in some hard (not very) way?

Raspberry Pi AI Kit – is a Raspberry Pi with Hailo AI acceleration module on top.

The context is that I was thinking about possibility to exploit ML models with stack Flux/Julia/“Raspberry Pi AI Kit”( for inference only). Of course I could export to ONNX and use it in TensorFlowLite, but may be there is a way to stay with Julia even in deployment phase. So the question maybe related more to “Whether Flux supports that thing?” , but may be there exist other solutions which lie beyond just Flux but still within Julia. So, I’d be appreciated to any experience/story related to this.

---

<div class="post-metadata">

**Author:** ![Palli](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/palli/32/3380_2.png) [@Palli](https://discourse.julialang.org/u/Palli)\
**Post date:** [August 15, 2024, 6:25pm UTC](https://discourse.julialang.org/t/raspberry-pi-ai-kit/118225/2 "2024-08-15T18:25:49Z")

</div>

> [@Vyacheslav\_Vorobyov](#):
>
> Does Julia support [Raspberry Pi AI Kit](https://www.raspberrypi.com/products/ai-kit/) ?

Most certainly does not, because it’s quite new, and also wouldn’t be Julia’s place nor needed, since it would likely work without any specific Julia support. Note, while Raspberry Pi is known to work with Julia, it doesn’t have any sort of official tier 1, or 2… support.

What you need is to have this $70 add-on AI chip I didn’t know of (thanks!), and do on Raspberry Pi:

> **[First Look: The Raspberry Pi AI Kit Is a Budget Add-On for Code Dabblers](https://www.pcmag.com/news/first-look-the-raspberry-pi-ai-kit-is-a-budget-add-on-for-code-dabblers)**
>
> Seeking a low-cost on-ramp into coding for AI? The Raspberry Pi AI Kit is a quick-install accessory for the Pi 5 to get you started. Here's what it's capable of right out of the box.

> $ sudo apt install hailo-all

As expected this didn’t work for me in Linux Mint on non-Pi, but hypothetically could have:

> **[Hailo-8L Entry-Level AI Accelerator Solutions - Hailo](https://hailo.ai/products/ai-accelerators/hailo-8l-ai-accelerator-for-ai-light-applications/#hailo8l-overview)**
>
> Hailo-8L Entry-Level AI Accelerator supports up to 13 TOPS, low latency, & power efficiency. Easy hardware integration solutions.

> Host Architectures: X86, ARM  
> OSs: Linux, Windows

> AI frameworks: TensorFlow, TensorFlow Lite, Keras, PyTorch & ONNX

Flux.jl or Lux.jl would need to support the chip or call some know API of it, or more likely(?) Keras or PyTorch etc. You can use all of those through Python, and with PythonCall.jl (and presumably on the Pi too, unless it’s really that memory limited to not support Julia runtime plus the Python runtime).

I’m not optimistic that Julia packages will support this soon, except if by calling the Python support, than I’m just not sure if Julia can be said to do any useful work. But AI is the future, also with Copilot+ PCs… so it will be interesting to see how they and this and Apple NPUs etc. get supported, I suppose will happen eventually.

It supports “13 Tera-Operations Per Second (TOPS)” is that good (enough) for something; compared to:

> Apple has stated the Neural Engine in the [M4](https://en.wikipedia.org/wiki/Apple_M4) can perform 38 trillion operations per second (TOPS), an improvement over the 18 TOPS in the [M3](https://en.wikipedia.org/wiki/Apple_M3).

Actually I think it’s 36 not 38 TOPS, and what TOPS means matters, is it bfloat operations or 8-bit floats or whatever, likely only integer operations 8-bit, since TOPS, otherwise all would state T **F** LOPS??

> **[Introducing Copilot+ PCs - The Official Microsoft Blog](https://blogs.microsoft.com/blog/2024/05/20/introducing-copilot-pcs/)**
>
> An on-demand recording of our May 20 event is available. Today, at a special event on our new Microsoft campus, we introduced the world to a new category of Windows PCs designed for AI, Copilot+ PCs.    Copilot+ PCs are the fastest,...

> With powerful new silicon capable of an incredible 40+ TOPS (trillion operations per second)

> **[Microsoft announces new PCs with AI chips from Qualcomm](https://www.cnbc.com/2024/05/20/microsoft-qualcomm-ai-pcs-snapdragon-arm-processors.html)**
>
> Microsoft wants to deliver Windows PCs that can keep up with Apple's MacBooks on artificial intelligence performance and strong battery life.