cool. would be nice to see some benchmarks~

We’ve developed Gemini Diffusion: our state-of-the-art text diffusion model.

Instead of predicting text directly, it learns to generate outputs by refining noise, step-by-step. This helps it excel at coding and math, where it can iterate over solutions quickly. #GoogleIO https://t.co/EmDAqNeXVv

Google DeepMind

cool. would be nice to see some benchmarks~

https://x.com/googledeepmind/status/1924888095448825893?s=46&t=bXRj3LXXGHjoj1idpl6gdQ

i wonder how this compares to Inception’s models https://www.inceptionlabs.ai/introducing-mercury

I’m bullish on diffusion models for text, if they work the speedup is going to be huge

software engineer @farcaster || prev: NEAR, Nethermind, Berkeley