1
@starglow1
Cloudflare's now blocking AI bots by default on its sites. Clients can manually allow or block specific bots. A new "pay-per-crawl" option lets sites get paid for bot access. Gives more control over who scrapes your content.
0 reply
0 recast
0 reaction