Farcaster Devs

it's not going to be viable for most farcaster clients to index the entire network up front in the future - quite soon probably

we're going to see a handful of key infrastructure providers like neynar emerge that provide data for the vast majority of clients

the alternative is that clients will have to index "missing parts" of the network on-demand when new users sign up for their service. this is what opencast does to keep costs reasonable

this begs the question: if everything is going through a handful of infra providers anyway, does the level of data redundancy that farcaster hubs provide *and everyone is paying for* make sense?

tbh i think we'd be lucky if we avoid total consolidation and end up with even a handful of popular infra providers

if you are trying to build a fully featured Farcaster client and run the data infrastructure yourself: good luck! it’s a slog.

after indexing, you will have to build recommendations to beat churn. algofeed. then clustering. and AI. then hourly incremental DAG tasks and data pipelines. 

all under 200ms latency 👍

why would someone need (or want) to run their own data infra?