@eirrann.eth

Local LLM/Hermes folks: proven better model on 5950X, 3090 24GB, 64GB RAM than Qwen3.8-Flash-Next UD-Q2_K_XL (65K, n-cpu-moe=32)? Production metrics: 28.1 decode / 244.9 prompt tok/s over 1.59M gen tokens; second window avg: 33.7 / 255.2 140W = current GPU thermal cap

2 replies

0 recast

0 reaction