Shaw
@shawmakesmagic
Hellooooooo https://github.com/ChenxinAn-fdu/POLARIS
2 replies
0 recast
12 reactions
Odilitime
@odilitime
Quantized models aren’t great
1 reply
0 recast
0 reaction
Shaw
@shawmakesmagic
It really really depends on the quantization o4-mini is almost certainly both distilled and quantized some models like deepseek are much more sensitive to quantization
0 reply
0 recast
1 reaction