Why do people think context window size is a big limitation for AIs to be able to fully replace humans as coders?

I'd say most of us keep a very compressed version of the codebase in our head and rely on code search and tools to get the details we need. Coding agents are already starting to do this using grep and other tools. They just need that initial context to get them going and then they can do the rest. Creating that initial compressed representation of the codebase they can reference to get them started would do the trick without keeping the entire codebase in the context.

The open web is dead, long live the open web. ⌐◨-◨

Building /farcaster

— gabrielayuso.com

I think this explains why I haven’t found Claude Opus to be that much better than Claude Sonnet despite being like fifty times more expensive.

Cursor is already doing a lot of legwork summarizing context as it goes, so it can keep a small context window cached no matter how long the conversation gets.