open source is a hell of a drug. i dropped an ios port of gemma 3n yesterday, just a few days after google released it (with android-only support), and already someone else jumped in, added image understanding, polished the UX, and is prepping a PR. insane. this is what it’s all about — no NDAs, no permission slips, just vibes and shipping. gemma 3n is a frontier edge model, and rn we’re watching a legit community ecosystem form around it in real time. that’s magic. huge thanks to @TheMagicIsInTheHole on reddit — here’s the screenshot they shared 👇
Cast image embed
sidhant avatar
check out my reddit post for more discussion: reddit.com/r/LocalLLaMA... don't sleep on this subreddit, massive alpha on here!
From the LocalLLaMA community on Reddit: Implemented a quick and dirty iOS app for the new Gemma3n models
reddit.com
From the LocalLLaMA community on Reddit: Implemented a quick and dirty iOS app for the new Gemma3n models
1
4
shoni.eth avatar
I’m still kind of baffled this can load into ram on a phone isn’t it like 4B param? I’ll have to read up but wow that image support is insane
1
1
sidhant avatar
it's even more insane than that. "Gemma 3n models use selective parameter activation technology to reduce resource requirements. This technique allows the models to operate at an effective size of 2B and 4B parameters, which is lower than the total number of parameters they contain."
1
2
shoni.eth avatar
oh interesting I guess this must be a new form of moe? I’m out of the loop but outside of this I think another huge exciting step is gluing together high speciality/niche models (I want to train on social data somehow, just not sure how yet) Thanks for the comment + great work
Kasra Rahjerdi avatar
does this support audio too? i haven’t figured out how to do audio input and output in gemma 3n
1
sidhant avatar
nope, I don't think google has made that available yet
1
1
Kasra Rahjerdi avatar
it’s all i want from it 🙃🙃🙃
1
Kasra Rahjerdi avatar
PS have you tried the 3 QAT models?
1
sidhant avatar
not yet! I assume they'd be faster but less "smart"
Pretty Blocks avatar
I've been wildly impressed with Gemma3 in general.
Show more replies