Justin Hunter pfp
Justin Hunter

@polluterofminds

I view all of this crawling as a balance. We’re going to be living in a post SEO world. And if you want your sites discovered, you’ve got to let the crawlers in. But at the same time, the cost of server resources is real and you have to mitigate the surge. https://lambdacreate.com/posts/68
0 reply
0 recast
0 reaction