Wonder if ChatGPT will be the last major model to be trained on the open web? robots.txt specifically disallowing crawling from LLMs unless getting paid for the data?

I doubt it. We’re at the start of an arms race between training and membership inference algorithms. https://arxiv.org/abs/2301.09956

Even if Western majors respect regulatory type regimes and respect robots.txt directives many won’t. The only defense is encryption not regulation.

Delver at contraptions.venkateshrao.com, running summerofprotocols.com, host of /gloom ☀️

So then people will go dark ie auth only?

People who care enough will. But as always apathy will rule most outcomes. Wrote about it yesterday https://studio.ribbonfarm.com/p/the-mediocre-computing-trilemma