[image] chatGPT policy needed? AI tends to do things that look sophisticated but are just bad copy-pasta from something on the internet that was a correct answer to some other question I wonder how this actually works. ChatGPT wrote some pretty amazing Matlab code for me, though with some synt…

It’s true. Same experience I made when playing… still playing around. As I said, quite awesome. Of course one has to stay alert!

IMV the best way to think about these models is by thinking of them as super-advanced keyboard prediction engines. They just chain together statistically likely sequences of words. By adding more words to the sequence as a “chat session” you steer the output. It doesn’t reason about where it foun…

It can do Julia too! I used it to help me with the initial layout of a small particle simulation. As you mentioned, quite a few bugs, but by talking to it I could get it to fix some stuff for me etc. At the end would I have been able to program it without it? Probably. Was it more fun having a “com…

I am wondering, what is the language ChatGPT is written. I guess it is probably not Julia. Would be really cool to have a project with so much publicity and interaction written here.

I heard it was trained with Ray

Ah, A16z again. They are almost everywhere. I mean only positives. But hey, do you think that similar results can be achieved also on this thing that is currently being cooked by Mr. @StefanKarpinski and by Mr. @ChrisRackauckas , I mean JuliaHub? Or JuliaHub is a very different thing? Asking seriousl…

Also wondering, how large it is? I think, I was reading somewhere that it takes more than one core to provide the answer, but the training? Would you have any estimation?

[image] j_u: but the training? Would you have any estimation? A LOT. How big do you think the corpus of text is that it’s trained on? How much did it cost just to accumulate that? How much does it cost to curate that corpus? It’s probably a huge datacenter full of drives just for the corpus. …

How big do you think the corpus of text is that it’s trained on? I have no idea. Never did anything with the language models. Thus I asked the question. Running ChatGPT costs $100k a day. With milions of users and the assumption that it takes more than a core to provide the anwer would be qui…

How does chatGPT work?

Offtopic

findmyway December 15, 2022, 12:31am 5

If you want to understand the underlying technology, this video explains the concept of Reinforcement Learning from Human Feedback (RLHF) pretty well.

Topic		Replies	Views
Are there efforts to improve ChatGPT for Julia code? Tooling	26	4165	July 24, 2023
LLM AI just for Julia? A proposal: Julia plus science LLM? General Usage machine-learning	4	1695	June 24, 2023
AI tools to write (Julia) code (best/worse experience), e.g. ChatGPT, GPT 3.5 Offtopic	62	17020	May 14, 2024
Julia ranking fairly good in code generating using ChatGPT Community	3	1486	November 19, 2023
Is Bard better at writing Julia than ChatGPT? General Usage question	3	388	July 14, 2023

How does chatGPT work?

Related topics