vishal
@vmathur
TIL cloudflare is turning on blocking for AI crawlers by default, unless the AI pays for the content. Interesting move considering they serve traffic to a large portion of the internet https://blog.cloudflare.com/content-independence-day-no-ai-crawl-without-compensation/
1 reply
0 recast
7 reactions
Samuel ツ
@samuellhuber.eth
Disabled it manually so I get the indexing. Distribution matters depending on what the content is
1 reply
0 recast
3 reactions
vishal
@vmathur
yeah totally. I wonder if other site owners will do the same
0 reply
0 recast
1 reaction