Gint1ng 👾 pfp
Gint1ng 👾

@gint1ng

MoE scales parameters but the expert bottleneck is just another attention problem dressed up.
0 reply
0 recast
1 reaction