Like many of us in the Machine Learning/Data Science community, I have been blindsided by the tsunami of developments in Large Language Models (LLM’s) in the past 6 month, not realising how fundamentally these advances would redefine ‘what is possible’ in just about any area of human endeavour. Si…

I think computers will find some way of communicating with us, provided they will see a need to do so. Probably by embedding electrodes in our brains.

[image] Kirby_Zhang: Maybe focus on making PyCall better and copy-free sharing of data more seamless. It may not be realistic to duplicate the amount of infrastructure going into Python. That is really cool, but I think Julia could begin building up infrastructure like it has with everything…

Maybe worth an issue if you can provide a reproducer. I tried the example in the package readme and it worked fine.

[image] nilshg: Maybe worth an issue if you can provide a reproducer. The error message did mention CUDA, which may have to do with the fact that I am running on an M1 Mac

[image] compleat: I tried this. None of the examples work now [maybe needs updating?] What is it that doesn’t work? Just tried the “AttentionIsAllYouNeed/copy” from the examples folder, and seems to train well.

Julia is on Google’s radar, including for LLMs, is benchmarked with highest capability jump in capability in their brand-new state-of-the-art language LLM (and intriguingly PaLM 2 is a smaller model that predecessor, and, still better; the trend of models has been going larger, then smaller in open …

At their description for the public: [image] Google AI PaLM 2 – Google AI PaLM 2 - Google’s next generation large language model. It excels at advanced reasoning tasks, including code and math The link for “excels” (synonym for state-of-the-art?) in that s…

I tried PythonCall a while back; I found it less stable than PyCall, and doesn’t have the py"" macro that executes pure python code. I tried mixing them but just ended up using PyCall only. You can get copy-free with PyCall, but it’s convoluted and easy to unintentionally make copies.

It’s the man-power issue. There was a tensorflow wrapper but even the wrapper couldn’t keep up with developments. Julia runs loop code well, is math friendly. It should probably focus on augmented libraries with Python core components. It’s back to two languages but with much faster and type-safe c…

Is Julia Falling Behind in Relevance? (because it's not used in LLM research?)

Offtopic

gdalle May 22, 2023, 9:14pm 60

Side note on PythonCall: there is an equivalent to the py"""...""" macro but it’s a bid hidden: Define Python function in Julia file with PythonCall? - #7 by cjdoris

Topic		Replies	Views
Why is Python, not Julia, still used for most state-of-the-art AI research? Offtopic knet , flux , machine-learning , mlj , sciml	65	11839	August 14, 2021
Has Julia met your need for AI and ML? New to Julia	26	2104	October 7, 2024
arXiv: "The State of Julia for Scientific Machine Learning" by Berman & Ginesin Machine Learning python , machine-learning , jax	31	3827	December 15, 2024
On Machine Learning and Programming Languages Machine Learning	48	9006	January 25, 2018
What do you work on? Why is it important? Community	29	4520	June 7, 2021

Is Julia Falling Behind in Relevance? (because it's not used in LLM research?)

Related topics