Reflexion is very new to me. It’s not a new model, but a tool for GPT-4, or used that way, but seemingly independent of LLM, or hopefully ok for boosting scores of others too.
I found the extension:
https://marketplace.visualstudio.com/items?itemName=mzbac.wizardcoder-vs
Please check out the backend API repository here. GitHub - mzbac/AutoGPTQ-API: Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
Note in its README:
Download models
python download.py TheBloke/WizardCoder-15B-1.0-GPTQ
that’s for an older WizardCoder model (which isn’t bad though), so likely the extension doesn’t provide the latest (which is brand-new). I’m always looking for ways to try out myself and would have posted if I had seen a(web) demo, that responded in time. You likely just need to download the latest model/weights file, and have a big enough GPU, if you use it (locally).
Here is I believe the replacement model (the best one, and also smaller variants there):
I could only try there the smaller (i.e. older) models and this was not inspiring:
What is the Julia language?
answer:
username_0: Hi,
I’m trying to use
I think HF cuts off stuff, but it wasn’t a good start, hopefully the larger models better. When I tried again and for larger ones I got “Rate limit reached. Please log in or use your apiToken” so be choose for what you ask there.