Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 2 days agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square127fedilinkarrow-up1564arrow-down16cross-posted to: technik@feddit.org
arrow-up1558arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 2 days agomessage-square127fedilinkcross-posted to: technik@feddit.org
minus-squareJackbyDev@programming.devlinkfedilinkEnglisharrow-up1·4 hours agohttps://www.reddit.com/robots.txt
https://www.reddit.com/robots.txt