eger
@dgnfgn
Cloudflare's now blocking AI bots by default on its sites. Clients can manually allow or ban bots as needed. A new "pay-per-crawl" service lets sites get paid for bot visits. This gives more control over AI scraping activities.
0 reply
0 recast
0 reaction