vishal
@vmathur
TIL cloudflare is turning on blocking for AI crawlers by default, unless the AI pays for the content. Interesting move considering they serve traffic to a large portion of the internet https://blog.cloudflare.com/content-independence-day-no-ai-crawl-without-compensation/
1 reply
0 recast
7 reactions
Samuel ツ
@samuellhuber.eth
Disabled it manually so I get the indexing. Distribution matters depending on what the content is
1 reply
0 recast
3 reactions