Proof of concept LLM chatbot built with Julia: KeemenaLM.jl

Similar to @pitsianis, I’ve added and tested preliminary AMDGPU support. I haven’t looked into intra / inter node communication and I’m unsure of its feasibility given my limited recent experience with Flux and Lux. As I’m not a professional developer, it’s likely better for you to handle the integration of other backends. I will update you if I find any meaningful information regarding extended communication on AMD. To better understand the model, today, I drafted a very short … PRIMER, which I’ll review and try to post here as a PDF by the end of the week. While I’m happy to discuss hardware technicalities, I cannot comment on your second paragraph. As indicated previously, my understanding is that the best thing you can do now is set up some form of a legal framework for this project, otherwise, it may end up as an exercise. However, I might be very wrong.

Great, it is merged, I can’t do a dynamic test, just read over it and made some changes to keep the MacOS Metal usage separate from the rest. Glad to see this done too :smiley: thanks!!

Legal… :sweat_smile: like what needs to be done??

Ok, so I will look to get a AMD gpu to work on it as well! great idea

if you are interested let’s make a specific topic for llms in julia