🤔 With 10k casts, for the same API requests (ex, fetch 1000 casts by fid) you must provision 10x the memory.

Dad, geek, conversation liquidity provider. vrypan.net (home), @l--o--l (fun). devcoin:$lemon3

And if you say, ok, I'll fetch 100 casts / request instead of 1000, then you need to make 10x the requests.

that's only true if every cast uses the max char limit. 

the distribution often skews much lower in practice.

Technowatermelon. Elder Millenial. Building Farcaster. 

nf.td/varun

For sure. But when you provision resources, you don't know in advance. If you create a buffer, or cache responses in a kv store, etc, you need to set some limits. You can't say, "one out of 100 times, this will crash"

but its probably ok to crash one times out of a million and then recover from it gracefully be reducing request size. 

and realistically, you can probably read a lot of casts into memory on modern machines, so the law of large numbers comes into play making the one in a million more likely