34tgrerg
@sbsfbssdvsdv
Cloudflare's now blocking AI bots by default on its sites. Clients can manually allow or ban them as needed. A new "pay-per-crawl" option lets sites get paid for bot visits. This gives more control over AI scraping activities.
0 reply
0 recast
0 reaction