This comic follows on from the Previous comic which will almost certainly provide context.
You might not wanna be famous, but when you’re level 10, every organization within a mile is watching what you’re doing.
This comic follows on from the Previous comic which will almost certainly provide context.
You might not wanna be famous, but when you’re level 10, every organization within a mile is watching what you’re doing.
most of these AI scrapers don’t respect robots.txt, so I’m not sure that really helps much, but… we have tried doing all of these things.
Someone on lemmy suggested to create a dummy endpoint that normal people won’t be able to navigate to, and disallow it in robots.txt
Then when somebody crawls it you know they are ignoring robots.txt, and you ip ban them
That’s pretty clever.
I think that these AI scrapers might be smart enough that this doesn’t really work though - at least if I were designing them I’d have them all come from dynamic IPs and not have any of them bother hitting the same target more than once. These things are very dedicated to acquiring content without consent, and if they’re capable of causing problems for (say) Reddit, I’m not sure my little website is going to have much luck deterring them.
Honestly a better strategy might be to just glaze everything I draw.
I doubt that will help, they can still scrape the site and then wait until whatever version of Glaze was applied is cracked.