shoni.eth
@alexpaden
couple notes on what i'm up to: - i'm making my farcaster wallet part of my LLC which also handles research and open source frameworks that i intend to launch a token under someday - all threads on farcaster is approx ~2B tokens (+/- 500M tokens based on data cleaning/formatting techniques) - i'm going to crowdfund the open embedding dataset using @nicholas tool after launch (at cost)
2 replies
0 recast
16 reactions
shoni.eth
@alexpaden
that is to say you could fit all of farcaster history in a 2B context window, the current largest context window is 100M tokens with Magic.dev's LTM-2-Mini
0 reply
0 recast
2 reactions
🎀 sonya (in theory) 🐰
@sonyasupposedly
> i'm making my farcaster wallet part of my LLC say more? what does this entail?
1 reply
0 recast
0 reaction