Resolution to "Server too Busy" Messages

[Bond]

All of the addresses may change automatically, but I'm not sure and I wouldn't want to take that risk.

I've done a few hours of research (ugh) on how to get rid of the spider bots, and I found how to create this file that the bots should check to see what folders they are allowed to index and whether or not you even want them indexing your website. Obviously the google spider isn't checking the file, which it should every 48 hours or so. I'm trying a lot of other different things also, so hopefully something will work.

[Ace195]

Originally Posted by Bond

All of the addresses may change automatically, but I'm not sure and I wouldn't want to take that risk.

I've done a few hours of research (ugh) on how to get rid of the spider bots, and I found how to create this file that the bots should check to see what folders they are allowed to index and whether or not you even want them indexing your website. Obviously the google spider isn't checking the file, which it should every 48 hours or so. I'm trying a lot of other different things also, so hopefully something will work.

I would contact google like GameMaster said I mean they should be reasonable people.

[GameMaster]

Bond, I think I have the answer to our problem.

http://www.google.com/webmasters/faq.html#nocrawl

[Bond]

Originally Posted by GameMaster

Bond, I think I have the answer to our problem.

http://www.google.com/webmasters/faq.html#nocrawl

That's actually the file I was talking about. Which isn't working...

I'll review that page though and make sure everything is in order.

Alright, I edited the file a little bit so hopefully it will work now.

I also added a meta tag that should tell them to go away.

[The Duggler]

I think you got it.

I haven't got the message for some time now.

Good job!

[Jonbo298]

It seems to be working correctly. I haven't seen any Google Spiders as Guests on GT yet since the editing/fixing.

We should applaud Bond for the work he has done. +rep