(no subject)
Feb. 24th, 2008 11:27 am![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
tithoniumbot/1.0 (bot; http://; bot@bot.bot) => 16791
That's hits-in-the-past-year, roughly. I'm going thru and identifying the spiders hitting my site so I can filter them out of hit counting. Nice of them to properly identify themselves, tho I see people saying that it does, at least, respect robots.txt. I think perhaps it's gonna get banned there.
That's hits-in-the-past-year, roughly. I'm going thru and identifying the spiders hitting my site so I can filter them out of hit counting. Nice of them to properly identify themselves, tho I see people saying that it does, at least, respect robots.txt. I think perhaps it's gonna get banned there.