Recently I downloaded and installed the latest version of log file analysis tool Analog. One of the more fascinating things I happened to notice was just how much of my traffic was from known robots — about 20 percent of the 600,000 monthly page views I serve up are read by robots of one form or another.
Or to put it another way, that’s about 2 gigabytes of bandwidth each month just to keep feeding the robots.
Yikes.