hadn't thought about it.
But the analogy of "system 2" (cf Kahneman) for thinking models is a good one
https://x.com/karpathy/status/1938626382248149433
(kinda like "count to 5 before you speak")

I’m so excited to announce Gemma 3n is here! 🎉

🔊Multimodal (text/audio/image/video) understanding
🤯Runs with as little as 2GB of RAM
🏆First model under 10B with @lmarena_ai score of 1300+

Available now on @huggingface, @kaggle, llama.cpp, https://t.co/CNDy479EEv, and more https://t.co/Xap0ymhCmr

The race for LLM "cognitive core" - a few billion param model that maximally sacrifices encyclopedic knowledge for capability. It lives always-on and by default on every computer as the kernel of LLM personal computing.
Its features are slowly crystalizing:

- Natively multimodal