How many of those bot are thieves?
High Point, NC - - (November 21, 2016) - - Bots crawl the Internet continually. Usually they are looking for something.
Bots can be helpful and bots can be harmful.
Are you getting 30,000 hit a day? Do you know how many of those "hits" are bots?
Of the bot "hits", how many are helpful bot "hits" and how many are harmful bot "hits"?
Without adjusting for bot traffic you probably cannot determine your web sites' true performance measurements.
Bots can send traffic.
Bots can steal content.
Bots can steal space (especially advertising space). Bots (rather, their owners) love to steal advertising space.
It is very likely that the impact of bot thievery on the Internet economy is massive.
Bots do more harm than many webmasters realize. (Bots love to run email spam scams.)
Over the years massive bot traffic has caused my sites' databases to lock up. I have had to move from service level to service level and, in the end, had my service providers give up and say they could not handle my traffic. (Much of that traffic was bot traffic.)
How much do you know about your "bot traffic"? Until you adjust for bot traffic your evaluation of your sites' performances will more than likely be skewed.
Article written by Clarence William Page