Content pfp
Content
@
0 reply
20 recasts
20 reactions

Selenka pfp
Selenka
@selenka
How to keep yout AI chats private? Gritual! Ritual dropped a thread about keeping your AI chats private, even when using open-source models. It’s a big deal because privacy is a mess right now, and they’ve got a clever fix. Let’s figure it out. ⤵️ You know how AI models, like the ones you chat with, can be super smart but need a ton of power to run? Open-source models are great because you don’t have to share your data with big companies like Google or OpenAI. But here’s the catch: running them yourself takes crazy expensive hardware ~$400,000 in GPUs! Most of us don’t have that kind of cash lying around. That’s where Ritual comes in with something called Secure Multi-Party Computation, or SMPC. Think of it as a way to let someone else run the AI for you, but without them seeing your private stuff. It’s like handing your diary to a friend to read, but the pages are magically locked - they can’t peek, but they can still help you with the heavy lifting.
1 reply
0 recast
1 reaction

Selenka pfp
Selenka
@selenka
Here is the problem: SMPC isn’t perfect yet. It’s slow because of tricky math stuff in AI models, like special calculations (called GELUs and softmax). But Ritual shared how devs have been working on this. Over time, researchers made SMPC faster ~10 times faster by simplifying those calculations. Still, it’s not fast enough for big AI models to be practical yet. Ritual also looking at new ideas, like mixing up data before sharing it, to make things quicker without needing heavy math. But here is the twist - they found a flaw in this approach. They built an attack that can unmix the data super easily, showing it’s not as safe as people thought. They’re dropping more details soon, so stay tuned.
1 reply
0 recast
0 reaction

Selenka pfp
Selenka
@selenka
Why does this matter? If Ritual pulls this off, you’ll be able to use powerful AI without giving up your privacy or your wallet. Imagine chatting with an AI about your finances or health, knowing no one can snoop. That’s the future they’re aiming for. I’m bullish because privacy is everything, and Ritual is not messing around. They’re tackling the hard stuff head-on. Check their blog for the full scoop. Would you trust a private AI like this?
0 reply
0 recast
0 reaction