Those who know what internet bots and spiders are, know that know that spiders and bots visit your site very day and multiple times a day. For those who don’t know here is the definition of bots according to Wikipedia:
An Internet bot, also known as web robot, WWW robot or simply bot, is a software application that runs automatedtasks (scripts) over the Internet. Typically, bots perform tasks that are both simple and structurally repetitive, at a much higher rate than would be possible for a human alone.
According to a recent survey, on an average about 51.8% of the website visitors are bots.
I recently had a conversation with one of the attendees of my Digital Analytics Association (DAA) workshop at Chicago eMetrics. She told me that she gets a report every week from their digital analyst. When asked, Digital Analyst confirmed that the report does not filter out any activity from spiders and bot becuase he does not have time to remove them. She was wondering if she should worry about it and push to remove the bots from report or just accept it.
What do you think? Do you think the report she is getting is worth anything?
Unless they are selling to spiders and bots, she is not getting an accurate picture of website usage by real customers.
Make sure to ask your analytics team if they are removing bots from reporting. If not, then do not accept the reports till they have done cleanup and are paying attention to it on ongoing basis.