I guess the sitemap has finally kicked in. I checked my stats last night, and so far this month Googlebot has eaten more than 5 Gig of bandwidth. Considering that my site only takes about 83 Meg of storage space and I normally only use about 7-8 Gig a month, I’m a touch shocked. Delighted too, since I’m seeing a lot of pages getting indexed.
Now I have to decide what to do about it. I only have 10 Gig of bandwidth a month, so I can
- Upgrade my hosting to get more bandwidth.
- Take a chance that this will only happen this month and just buy more bandwidth.
- Find a host with a plan that offers more bandwidth.
I can’t take too long thinking about it. I made some changes last night to hopefully ease the strain, since I saw that Googlebot was getting session IDs on my forum, so I tossed in some code to prevent that. Other than that, I don’t see much I can do to stop it since I have no intention of blocking the bot. I suppose I could limit it if I wanted to certain areas, but since I really want the whole site spidered that would be foolish.
