@dramaticcat@sh.itjust.works to Lemmy Shitpost@lemmy.world • 9 months agoChad scrapersh.itjust.worksimagemessage-square97arrow-up11.06Karrow-down129
arrow-up11.03Karrow-down1imageChad scrapersh.itjust.works@dramaticcat@sh.itjust.works to Lemmy Shitpost@lemmy.world • 9 months agomessage-square97
minus-square@DAMunzy@lemmy.dbzer0.comlinkfedilink17•9 months agoBut, but, norobots.txt! Chad doesn’t care!
minus-square@PoolloverNathan@programming.devlinkfedilinkEnglish6•9 months agouses curl manually instead
But, but, norobots.txt!
Chad doesn’t care!
uses curl manually instead