Here's the goal - to find a formula whereby we can measure the efficacy and accuracy of keyword research sources like Overture, KeywordDiscovery, Hitwise's Keyword Intelligence, Google's Adwords Estimator, MSN's Adcenter, and others. There's just a few simple steps to follow:
- Gather a large list of hundreds, hopefully thousands of keyword terms and their actual search numbers at Google - this can be done by getting data from advertisers who were always listed on the 1st page of results for the term through AdWords (using the impression numbers for "exact match").
- Gather a list of the estimated numbers reported by all of the major keyword research services for those same terms and phrases.
- Distill the data, tossing out those phrases that might cause issue or those reports that wouldn't have a huge impact and keep only the best, most useful ones.
- Compare the two sources (Adwords Impressions and estimator tools) and find out fascinating information like - which tool is most accurate? Is there a formula we could create that would predict (based on all the estimation sources) within 10%, 20% or 30% of actual traffic?
To my mind, this formula would be priceless to search marketers. Once you can accurately predict search traffic (even if it's off by 20-30%), you've got a system that doesn't require a massive spend at Google to predict actual searches. Even if the data isn't conclusive, the results will be incredibly enlightening.
We have a few clients (and some botched test data) that we can provide for the project, but we really need your help to make it possible. My promise is that we'll collect the data, report it all honestly (but anonymously - not revealing any of your keywords or those of clients) and build a tool that will use this formula. We'll also provide the exact formula publicly, so that anyone can use the same information to build their own tools, use it in their internal calculations, etc.