Homelabs

So you wanna self-host an LLM? https://blog.lytix.co/posts/self-hosting-llama-3

Great cost analysis on self-hosting an LLM with appropriate hardware.

tldr; ChatGPT is currently cheaper unless you your LLM has 100% utilization, which is unrealistic.

Important question: how much value do you give to privacy, control and lack of censorship?

Answer is obviously subjective, but it explains why some will still choose the local AI.

I like to think I value those three highly, but in practice I'm a sucker for convenience. Control of both data and the software that manages it I do still value, largely due to distrust in tech products standing the test of time.