tryjdtyrjty
@erhehrt
Cloudflare's now blocking AI bots by default on its sites. Clients can manually allow or ban bots as needed. A new "pay-per-crawl" option lets sites get paid for bot access. This gives more control over who scrapes their content.
0 reply
0 recast
0 reaction