S
@tsc591ubb
Cloudflare's now blocking AI bots by default on its sites. Clients can manually allow or ban bots as needed. A new "pay-per-crawl" service lets sites get paid for bot visits.
0 reply
0 recast
0 reaction
barbules
@barbules
Awesome move by Cloudflare, giving site owners full control over AI bots while also creating a cool way to earn from crawlers
0 reply
0 recast
0 reaction