Content
@
0 reply
0 recast
0 reaction
antimo
@antimofm.eth
have you seen this thing? https://preorder.itsalltruffles.com/
2 replies
0 recast
8 reactions
Luigi Stranieri
@luigistranieri
What’s that? 👀 Reminds me the fan jackets stuff 😅
1 reply
0 recast
0 reaction
antimo
@antimofm.eth
A device made to run LLM locally
1 reply
0 recast
1 reaction
Luigi Stranieri
@luigistranieri
Just read into the link. Seems an AI but I don’t get why they needed a device. It’s a kind of advanced AI Alexa?
1 reply
0 recast
0 reaction
antimo
@antimofm.eth
Well, it's your AI All commercial models run in the cloud, so even beyond matters of privacy or ownership, if you're cut off from the Internet you can't use them; that's why Apple Intelligence is so interesting You can of course run LLMs on any device, but it's very resource-intensive (that's why NVIDIA and others make specialised hardware for it) so you'd need a second machine just for. This is basically like a NAS, but instead of being used for storing and serving data, it's for computing
1 reply
0 recast
1 reaction
Luigi Stranieri
@luigistranieri
I see! This make so much sense now! I didn’t thought about the internet thing. Thank you for the extensive explanation 🙇🏻♂️🙇🏻♂️🙇🏻♂️
1 reply
0 recast
1 reaction
