surprisingly not much discussion on Apple's Foundation Models.

i believe it's the first OS-level API to gain access to free, offline, and private LLM

w/o having to install anything.

here's a great vid to get started.

surprisingly not much discussion on Apple's Foundation Models.

i believe it's the first OS-level API to gain access to free, offline, and private LLM

w/o having to install anything.

here's a great vid to get started.

https://www.youtube.com/watch?v=6Wgg7DIY29E

yeah, you still ahve to download apple intelligence.

i succesffully built a chatgpt clone on it its fine for a 3b model

the guardrails are nuts (check the apple forums for devs / ml)

the structured output constrianing api is also fucking great. mostly for agentic tool calling