How accurate is Alexa? Test reveals all (almost)

We use the traffic ranking tool Alexa to keep an eye on what’s happening on the web; it’s a good measure of the speed with which social media is transforming web habits and economics. But most of its users know that Alexa’s a relative measure, so if a chart’s showing downward movement it doesn’t necessarily mean that traffic is falling.

Alexa measures traffic by encouraging people to download its tracking tool to their browser, and then monitors their usage. Most Alexa users know that it indicates a site’s share of reach, rank and page views by revealing what proportion of the Alexa sample has visited the site, and that there’s no clear indication of absolute numbers. Also, Alexa clients tend to be skewed towards techies and other early adopters so it doesn’t necessarily give an accurate view of market share across internet users as a whole.

To test Alexa accuracy and find out what its results might indicate in absolute terms, I decided to do a quick and dirty experiment with a sample of one.

I took a fairly big site for which I know absolute results (no names) and plotted it against the Alexa graph. Here’s the result for the last six months:
I could match the charts for the first three months or the last three months but not for both. There seems to be a step change between them.
Alexa 1

This is the first chart, showing a nice correlation for the first three months…

Read the rest of this entry