Google's Traffic Numbers Inaccurate?

Over the years, TMC has tried many third party measurement sites and without a doubt, Google Analytics under reports traffic numbers as compared to other independent measurement services by an order of magnitude in many cases. Why is anyone's guess but this article confirms that Google's in-house numbers are lower than virtually all other measurement methods. This includes the well-respected Comscore.

In addition as John Battelle points out, there should be natural suspicion of measurement practices of any company which also runs an ad network. Here is an excerpt of his post which discusses Google Ad Planner in detail:
 

In short: If you were a media planner using Google Ad Planner, and you were looking for larger sites, you would be led to sites that are running Google AdSense, on average, over sites that do not. Net net: This data indicates that Google Ad Planner pushes ad dollars to Google sites over non-Google sites. This makes sense - Google has data on Google users, after all. So that data might naturally bias toward Google-related sites.

But as I said in my coverage: "Such a tool must be neutral and not bias advertisers toward buying on Google properties or those that have Google ads, which of course is going to be a perceived bias in any case. Such is the price of being Very Big."

So far, not so good on this measure. As Gian and Comscore have long pointed out to me, it takes more than raw data to make for good measurement. Ideally, you weight your data with a lot more knowledge of its context - what kind of machine is creating it (work or home? Man or woman? etc.). While Google once blended Comscore demographic data into its ad network, Comscore confirmed to me that this is no longer the case. And while it is subject to endless criticism, Comscore does have a lot more practice at this game than does Google. At least for now.

This data once again raises the question, long asked, of how Google is measuring in the first place. Most believe Google must be leaning heavily on its Toolbar data (see TC for more here and Danny here), and this data does nothing to counter that argument. The strong bias toward Google network sites is suspicious - one can imagine that folks who might install the Google toolbar are clearly already biased toward visiting Google-related sites, for example.

But Google will not acknowledge any use of the Toolbar. Instead it said in its announcement: "Google Ad Planner combines information from a variety of sources, such as aggregated Google search data, opt-in anonymous Google Analytics data, opt-in external consumer panel data, and other third-party market research."

As I pointed out earlier, I don't think such coyness can stand. I've pinged folks at Google to get a response on this, and as soon as I do, I'll update this post.

In short, it is difficult to trust any measurement numbers unless you know how the numbers are being measured. Until Google explains how it calculates traffic in more detail, there should be natural suspicion. This is especially the case as Google seems to be the only service reporting such low traffic numbers. Perhaps they do know something that everyone else is missing but if they do they should tell us what it is.
The opinions and views expressed in comments, blogs, etc. are those of the authors alone and not necessarily those of TMC, TMCnet, or its editors. TMCnet reserves the right to edit, delete, or otherwise make changes to the content that appears on these pages at its own discretion and as it deems necessary.
| 2 Comments | 0 TrackBacks

Listed below are links to sites that reference Google's Traffic Numbers Inaccurate?:

Google's Traffic Numbers Inaccurate? TrackBack URL : http://blog.tmcnet.com/mt/mt-tb.cgi/37011

2 Comments

you forget about google ever revealing anything. they're too secretive mostly for 2 reasons, fear of competition and fear of spammers.

Good read. It would be nice to know what exactly we are looking at when observing traffic data.

Leave a comment

Recent Activity

Today

Saturday

Friday

More...

Recent Comments

  • Blatant Lying: Anyone even thinking in investing in this stock has to read more
  • Scott: My name is Scott Hardin. I am the son of read more
  • Scott: My name is Scott Hardin. I am the son of read more
  • Backbooner: The answer to that is the same as how "someone" read more
  • Bart: "It's remarkable xG has managed to shut Marc up. I read more
  • Backbooner: It's remarkable xG has managed to shut Marc up. I read more
  • prefabrik: How can be a cycle set up and controlled? Is read more
  • Sheeri: IPTV, is where DSL was back in early 90s. We read more
  • zayıflama: Your could ask someone from Gimp for Mac community read more
  • Peter Koz: Rich, I am interested in your comments regarding Proxim's new read more

Subscribe to Blog

Blogroll

Recent Entry Images

  • itexpo-east-2009-exhibit-hall-aisle.jpg
  • google-tricycle.jpg
  • wes-durow[1].jpg

Category Archives

Around TMCnet Blogs

Latest Whitepapers

TMCnet Videos