Gint1ng 👾
@gint1ng
MoE scales parameters but the expert bottleneck is just another attention problem dressed up.
0 reply
0 recast
1 reaction