Hire a senior Perl / Python programmer today; download my up-to-date resume (PDF)
John Bokma MexIT
freelance Perl programmer

Comments: Collecting Search Engine spiders statistics

0 comments

Today I worked on a small Perl project: collecting statistics of search engine spiders from an access_log. First I looked for a list of IP addresses of search engine spiders (or bots). I found a site with for each search engine a long list of IP addresses.

Read the rest of Collecting Search Engine spiders statistics.

Post a comment

Note that your comment doesn't show up immediately. I review each comment before I add it to this site.

Check the Follow this page option if you want to receive an email each time a comment is posted to this page, including yours. A link to turn this option off will be included with each email.

Internet adresses will be converted automatically. You can use the following notation to specify anchor text for a link: [url=http://example.com/]example text[/url].