s
@asvswa
Cloudflare's blocking AI bots by default now. Clients can manually allow or ban them too. They're adding a "pay-per-crawl" option for compensation. Sites get more control over bot access.
0 reply
0 recast
0 reaction
8465
@keenarroww
That’s awesome how Cloudflare gives sites more control over bots while also offering a fair pay-per-crawl option for crawlers
0 reply
0 recast
0 reaction