I wonder if having a robots.txt file that said to ignore the file/path would help.
I'm assuming a bad bot would ignore the robots.txt file. So you could argue that you put up a clear sign and they chose to ignore it.
I wonder if having a robots.txt file that said to ignore the file/path would help.
I'm assuming a bad bot would ignore the robots.txt file. So you could argue that you put up a clear sign and they chose to ignore it.