Get your own customer support community
 

Your spider won't leave my site alone

Hi.. What's your spidering policy? I had an RSS feed translated yesterday (thank you) and something at your IP address has been fetching the RSS ever since. The RSS file is actually static and simply there to inform people that the project is now closed. Today I've temporarily renamed the file so that it returns a 404 which is so far being ignored.

[Tue Nov 18 14:12:11 2008] [error] [client 207.7.120.226] File does not exist: /usr/local/www/data/plogger/plog-rss.rss
[Tue Nov 18 14:12:12 2008] [error] [client 207.7.120.226] File does not exist: /usr/local/www/data/plogger/plog-rss.rss
[Tue Nov 18 14:19:19 2008] [error] [client 207.7.120.226] File does not exist: /usr/local/www/data/plogger/plog-rss.rss
[Tue Nov 18 14:19:20 2008] [error] [client 207.7.120.226] File does not exist: /usr/local/www/data/plogger/plog-rss.rss
Inappropriate?
1 person has this question

User_default_medium