privacy

My GPU doesn't have enough vram to get decent results from Ollama running locally. Any suggestions for how best to spend funds to get private llm facilities?

👀
I am hanging out for the Nvidia DIGITS mini desktop box. Not out yet. Keen to hear what others might be reaching for.

Established 1968. Cast about parenting, life in 🏴󠁧󠁢󠁷󠁬󠁳󠁿 South Wales 🏴󠁧󠁢󠁷󠁬󠁳󠁿, coding, being older than most around here and general nonsense.

🐦‍⬛<🐵> ← 🙈🙉🙊 → /phil →  github.com/philcockfield →  
ƒ(🌳) →  🧫 /sys  ←  @cell <T>, 🧠 small-tech human.

👀
I am hanging out for the Nvidia DIGITS mini desktop box. Not out yet. Keen to hear what others might be reaching for. 

https://nvidianews.nvidia.com/news/nvidia-puts-grace-blackwell-on-every-desk-and-at-every-ai-developers-fingertips?utm_source=chatgpt.com