Groq enables much faster throughput at the lowest cost possible! Almost 500 tokens per second for lower cost!

🇧🇷🇺🇸 - Book: Making Things Think: https://holloway.com/mtt Investor in Wander, Carry, Footprint, Merkle Manufactory (Farcaster), Dynamic, Paragraph

but what’s the quality? it’s not on any of the quality lists

because knowing is finding the limits | swabbie.eth

i didn't know that. this comparison lists them separately with unknown # of parameters for grok, but it knows that value for Mixtral 8x7B?
https://zapier.com/blog/best-llm/

they built an asic and named it language processing unit.

and also built their own compiler.

in simple terms they converted any runtime indeterminism to being deterministic.

@giu can you translate this chart into low brow stupid for the dummies in the room?