Hi all,
For me, one of the great benefits of the current AI tools has been that I can get fast and quite useful feedback on my drafts. I recently worked on judgment aggregation and crowd wisdom, which gave me the idea of organizing a kind of panel review of my drafts, where multiple LLMs (which could be both cloud models and local models) can discuss a draft before making final recommendations. The results were beyond what I had hoped for.
Organizing the panel review wasn’t very difficult, but I was able to turn this into a Julia package only with the help of Claude. The result can now be found here. I wasn’t able to find anything exactly like it on the Internet, but I could easily have missed things. (I know there is refine.ink, which gives very detailed feedback but which is quite expensive; the package creates reviews at very low cost, or even zero cost if you only run local models.) If you know of similar software, I’d love to hear about that. If you give the package a try, feedback and contributions are very welcome.