From the Fingers of Henrik Flensborg Rants, Raves and Recommendations about marketing and health

19Dec/040

Spiders loves a busy blog

I started this blog on November 22 and search engine spiders have been feasting from it ever since.

Inktomi Slurp picked up 102 pages in November (12.75/day)
AskJeeves/Teoma picked up a measly 7 pages (0.88/day)
MSN picked up just 2 pages (o.3/day)
Google grabbed just 1 page (0.1/day)

Inktomi was actually the only spider that really picked up my pages.

But this all change in December

December stats so far:

Google grabbed 326 pages (17.2/day)
Inktomi Slurp grabbed 200 (10.5/day)
MSN grabbed 182 (9.6/day)

No sign of AskJeeves/Teoma this month, but who cares as long as Google is hungry :-)

So far Google is showing 95 pages for this site, Yahoo is showing 7 and Tema and MSN are not worth talking about.

Another far more interesting site is my little experimental book site.

This is what happened in November:

AskJeeves/Teoma: 6589 pages (219.6/day) :-)
Inktomi Slurp: 1286 (42.9/day)
Googlebot: 8 (0.3/day)
MSN: 7 (0.2/day)

GoogleBot and MSNbot were initially slow to pick up the site, but this changed in December.

AskJeeves/Teoma: 739 pages (38.9/day)
GoogleBot: 603 (20.1/day)
Inktomi Slurp: 341 (11.4/day)
MSNBot: 71 (2.4/day)

Google is only showing a measly 47 of the pages it has spidered, while Yahoo is showing 613 pages in its index.

I have no idea when Teoma will update itsindex, but I expect Google to start showing several hundred pages shortly.

The coolest thing about frequent spider visits on this blog isn't just that more and more pages of the domain gets included in the search engines, but also that any new site I launch can get spidered extremely fast :-)

Filed under: General Leave a comment
Comments (0) Trackbacks (0)

No comments yet.


Leave a comment


No trackbacks yet.