does this ever happen to you, and how to i kick them off?

Ban *.google.com

or do a DNS on google.com

ban all IP addresses listed.

A friend of mine had MSN's web-bot crawl all over his forums. Since MSN was crawling his page ten times a day his bandwidth usage increased so high... actually went over his 3GB/month limit. He had to ban all of MSN's IPs.

QUOTE (bd1308 @ Aug 18 2005, 11:30 PM)

does this ever happen to you, and how to i kick them off?

I thought that you knew all this stuff. Ever hear of something called "The Robots Exclusion Standard"?

Here's a tutorial

Robots.txt is the way to get rid of them. Of course.. then your site won't show up on search engines.... if you want your site to be found, then let the bots crawl. They will bring traffic. Unless of course, you don't want the traffic.

traffic!? they logged on over seven thousand times.....

like three thousand times since monday.....


i banned that IP....so it's good.