@clun.eth

Has anyone here been able to use small (~7B params) open source models for anything remotely useful? I mean it’s incredibly cool that you can run them locally on your phone but they’re just dumb as rocks. The only example I can think of is the model underlying autocorrect in iOS which AFAIK runs on device.

2 replies

0 recast

0 reaction