Stephan
@stephancill
Does anyone with 100 AI agents running simultaneously and $10k cursor bill actually ship?
3 replies
1 recast
20 reactions
Harris
@harris-
At that point does it make sense to just invest in a local AI setup?
1 reply
0 recast
1 reaction
Stephan
@stephancill
Good question Do open source models compete with sota right now?
3 replies
0 recast
0 reaction
Colin Charles
@bytebot
You can use Deepseek, Qwen, llama, via ollama locally. Or buy a beefy Mac mini/studio. I haven’t found it to be fast enough with what I have but it’s good to use OpenAI compatible things
2 replies
0 recast
0 reaction
Stephan
@stephancill
Even if it were fast enough is it any good compared to the frontier rn?
1 reply
0 recast
0 reaction
Colin Charles
@bytebot
Nope. Llama is let’s just say not too impressive. Qwen is underrated. I haven’t tried the new Deepseek and I can’t comment on what mistral has given recently either. It’s pretty hard to beat Claude, Gemini, and ChatGPT frankly. This is “correct” as of today - this can change later of course.
1 reply
0 recast
1 reaction
Stephan
@stephancill
Let’s hope 🤞
1 reply
0 recast
0 reaction