destinydestiny
@destiny521
Cloudflare's blocking AI bots by default now. Clients can manually allow or block them too. A new "pay-per-crawl" option lets sites get paid for bot visits. These changes give more control over AI scraping.
0 reply
0 recast
0 reaction