Showing posts with label Keyword. Show all posts
Showing posts with label Keyword. Show all posts

Sunday, 26 June 2011

Free Keyword Competition Research

free-keyword-competitive-research


The term "competitive research" conjures up all sorts of imagery like expensive tools, shiny buttons, cute charts, and fancy (sometimes foolish) language about precise insight into a particular site or marketplace.


In reality we know that such claims are usually best taken with a large grain of salt. Most competitive research data is scraped from search engines and then has custom filters applied to it. Such filters can actually be a detriment to the data because, in desperate attempts at differentiation, tool-sets routinely use metrics which get overly convoluted with custom values and such that the final product because overhyped and underwhelming.


Some tools make up for their sampling errors by allowing you to upload your keywords & data directly into their database. The problem with this is that you are putting keywords which were "below the radar" into a database that your competitors may be using. Why just give away your data to the competition like that? Talk about working against yourself!


Let's remember that these custom metrics and estimates are typically extrapolated off of scraped data, or data purchased from IP's, or data from custom toolbars, all of which are data samples. So it is kind of like; scraped data +/- data extrapolations + in-house data + custom metrics = final product.


It is reasonable to assume that the more custom or guesstimated layers you build off of occasionally unreliable data (waves at Google's keyword tool and SERPS) the less and less targeted that data is. Moral of the story is, "choose wisely young jedi".


Getting Useful Data for Free


Now that we've set the expectation stage (don't expect tools to be a push button, slot machine win) you might feel like paying hundreds or thousands a month for these kinds of tools is a bit much. Sometimes yes, but multiple data points certainly have their advantages and it's not that the data is junk by any means, it's just that the data shouldn't be relied upon as if it were scientific. The data can most certainly be helpful but it comes down to ROI for you and your specific project(s).


free tools


There are many tools you can use to get lots and lots of decent keyword competition data for free. We aren't going to be covering free trials, just tools that give you what the have for free or tools that give enough useful data inside of a free version of their product.


If you are in the competitive research stage, you've probably already got a topic in mind. So we'll assume that you are doing competitive research on the keyword "camping equipment".


Accessing Free Tools


You could do a specific bookmark folder which encompasses links to your free tools for easy access. The first things you will probably look at are:


  • the SERP for your keyword

  • age of ranking sites

  • links (total links, links to domain, links to page, edu/gov links)

  • domain age

  • domain name (brand, exact match, both, none?)

  • signals of trust (key directories, dmoz, twitter)

Those data points can easily be accessed with SEO For Firefox.


SEO For Firefox


logo


SEO for Firefox is a free firefox extension which will give you important SEO metrics quickly, from a variety of reputable data sources. Typically, you might want to aim for in at least the top 3 given all the stuff that could be included in a SERP like:


  • a map

  • Google products

  • Google images

  • Google shopping results

  • YouTube videos

  • News results

  • Real-time results

  • and so on...

You can get a pretty good initial glimpse of the competition metrics within a few seconds. This is clearly a brand-heavy SERP and it is reflected in the SEO metrics. Here's a screen shot of what you'd see for a particular domain:


seo-ff-results


All things considered this is a pretty strong domain. It's a brand, has lots of links, .edu links, also ranks highly in Bing-powered Yahoo!, and has a PR 6 to boot.


Another cool thing about SEO For Firefox is that you can export the results into a .csv file for further research, processing and comparison. If you don't have a copy of Office for Mac or Windows already then, in keeping with the "free nature" of this post, you can use Open Office.


SEO Toolbar


Maybe you know the sites you want to research already or maybe you want a graphical, side by side comparison of up to 5 sites in your market. You can use our SEO Toolbar to accomplish this quickly and efficiently. If you click on the green arrows on the right side of the tool bar, you are presented with a GUI for the processing of up to 5 sites at ones (screenshot below)


toolbar-compare-sites


The comparison feature gives you access to key, relevant SEO metrics side by side for up to 5 sites.


So by now you should have a spreadsheet or three containing relevant data for the top sites on a particular keyword


Link Tools


Now that you've gotten some of the higher-level metrics out of the way, you can dive into examining the link profile of a competing site.


You can use free tools (or free versions of paid tools) to look at the links from a competing site, tools like:


  • Yahoo's Site Explorer

  • Blekko's SEO Tools

  • Open Site Explorer

  • Majestic SEO

While it's a good idea to get data from a variety of sources, and run them through a tool like Advanced Link Manager to get a full(er) picture of things, you can get some juicy data for free.


When doing competitive research for a keyword I want to know what the anchor text profile looks like. When I am doing competitive research on a domain there are other relevant data points like top pages, most linked to pages, and total number of unique domains linking at the domain or page (whichever is ranking).


Blekko and Open Site Explorer are the ones I use for targeted and quick anchor text distribution views. Yahoo! generally ranks the best links first and allows for a CSV export, Majestic's free account gives limited data on referring domains, top back-links, and top pages. So for the purposes of looking at anchor text, I prefer Blekko and Open Site Explorer.


Blekko


Blekko has a link to SEO data and Links data, as shown below:


blekko-links-to-data


The Links selection will bring up a Yahoo! Explorer-like list of links, the SEO link option brings up a bunch of SEO data like:


  • links to the domain

  • links to the page

  • anchor text information

  • links broken down by geography

  • external links

  • pie-chart, graphical representation of link data points

  • and other non-link related, but helpful, data (crawl data, site pages, etc)

The data is free, you get the data they offer without registration requirements.


Open Site Explorer


Open Site Explorer is a quick and easy way to get the type of data we are looking for in this example (anchor text profile).


They currently have a 30 day trial and offer 3 plans:


  • Free, No Registration - limited to 3 reports per day, shows up to 200 links and top 5 link metrics for a given criteria

  • Free, Registration Required - no limit on reports, 1,000 links returned, top 20 link metrics for a given criteria (anchor text, top pages, etc)

  • PRO - part of subscription to SeoMoz, up to 10k links, no limit on metrics

  • CSV export available for all plans

If you know the sites you want to look at, and the keyword(s), you can likely get away with just using it as a guest. However, the free but registered plan does give you a bunch more data. What I like in this example is that you basically type the domain name in, hit enter, then click on the anchor text distribution tab and the anchor text data is right there:


anchor-text-ose-example


You'll see the actual anchor text, the number of domains linking with that anchor text, and the total links with that anchor text in them (good way to spot site-wides from one domain). In this example, our target keyword is not in the top 5 (or 20) with respect to anchor text occurrences. This domain is a large brand though, so you'd likely want to make sure you could build an authoritative and useful site about the topic in order to overcome Google's love affair with brands.


Checking the On-Page Optimization


Though I believe the link data and domain data to be mostly paramount, the on-page criteria follows closely in the importance department.


This is pretty self-explanatory and you don't really need a full blown tool for this. Basically you'll want to look at things like the title tag, meta description tag, and the on-page copy itself.


You can do that pretty easily with just your eyeballs, but the SEO Toolbar also has a feature where you type the keyword into the box in the upper-right, and click the highlighter:


seo-toolbar-chocolate-truff


In this case I used 2 words, and they are highlighted in different colors:


godiva-choc-truffles


This can give you an idea of how the site is using the copy to say, scream, or shout what the page is about. Sometimes you'll find that sites might just be ranking for a keyword or phrase based on the authority of their domain. If they are ignoring the on-page and off-page (links) for a keyword, it could signal to you that this might be a keyword worth pursuing and a keyword you can reasonably expect to rank for.


Making it a Process


Competitive research is just one piece of the puzzle, as you know. I find that breaking the entire process down into manageable chunks can help each process be more productive and efficient. This would be my process when researching the competitiveness of a keyword. While there are other pieces to your SEO research you should note that you do not need to spend hundreds or thousands of dollars on fancy competitive research tools off the start.


Save the money you might spend on tools on link development, content development, and content promotion.


Categories: 

Generated by BlogIt

BlogIt - Auto Blogging Software for YOU!

BlogIt - autoblogging software for YOU

BlogIt - autoblogging software for YOU

12 Popular Keyword Organization Tips & Tools

Before Google's Panda update an effective SEO strategy was to "make a page for everything." If you are Wikipedia that strategy may still work, but for most websites that approach is a high risk & low return approach. Clustering like keywords together and using that to help set up your site's information architecture is a lower risk and higher return strategy.


Given Google's new approach to search (where dead weight can harm your good pages) organization is more important than ever.



Let's say you have a big list of keywords which is not well organized & you want a quick and dirty way to organize it. Here are a dozen different tips and tools to help you organize your keywords.


Ad Group Filter


We created an ad group organizer tool which aims to create a footprint for keywords by putting muti-word keywords in alphabetical order & stemming the keywords. The output is TSV, so you can copy it and paste it into a spreadsheet for further analysis. It also allows you to use stop words to filter the list. This can not only be used for organizing keywords for paid search, but also to help organize them for your SEO efforts down to a per-page level.



RKG Duck


RKG Duck is a Perl clipboard extension which was the inspiration for our above tool. This tool works well in spreadsheets, but it takes some level of programming sophistication to get working.



Wordstream Keyword Grouper


Wordstream's keyword grouper allows you to see niche keyword groups at a fairly granular level, with them emailing the results to you.



SpyFu Keyword Groupie


Spyfu's Keyword Groupie allows you to look up a competing site's keywords & see them organized by root word. In addition to listing keywords by root word, they also give you the option of viewing the top 100, 500, or 1000 keywords for a site.



The big benefit with SpyFu is that you can view data on a competing site & use their performance as a bit of a filter for you, but the downside is that at times it can be a bit slower than the above tools. That is to be expected though, because it is searching through a database of records related to sites, rather than just applying a filter or returning results.


They allow you to browse keywords to drill down in areas of interest. Another nice feature is that they show you keywords they feel you are missing out on by putting them in bold, so this tool is great both for looking up competing sites & for looking up your own site to see what you missed.


Google AdWords Desktop


There are a couple different ways to use the Google AdWords editor to group keywords. Here is a semi-automated way (where you still have a bit of human editorial in the process to manually filter to find themes & create groups)



You could do similar to the above with Microsoft Excel's table filters. And if you are combining multiple data sources / tables in Excel this AbleBits merge tool is handy.



Google also offers an automated option inside Google AdWords editor to help organize keywords into fairly tight groups.


First create a new ad campaign (and its settings can be a bit arbitrary off the start as you are mainly using this to help automate data sorting). You only need to create 1 ad group in that ad campaign and then bulk upload a group of keywords into it.



Next use the keyword grouper tool, as shown here.



In the keyword grouper you can use the "generate common terms" option to automatically create keyword groupings. Note that in the right box you can add stop words & other words that you don't want them to cluster keyword groupings around.



Google then spits out a result set you can use, with the keywords clustered into tight groups. Note that sometimes they footprint geo-local keywords similarly even if they are for multiple different areas, but outside of that it is a pretty nice tool considering the amount of work it does in what amounts to a 2-minute process.



Rank Checker


Put your site in rank checker and see how you rank for your target keyword list. If your site is nowhere to be found for a keyword then that may indicate a need to create more content pages around those new topics. If your pages already rank well then see how well they are optimized. A small amount of link building & on-page SEO can go a long way if you were already ranking for a keyword that you were not intentionally targeting.



If your site is brand new & has no authority (or you are researching a new market) you can search for the rankings of a popular website in your niche and see where they rank. Export the ranking data and you can sort the Excel spreadsheet by URL, which should help you cluster your keywords around a similar strategy that top ranked websites are using.


You can pull data on competing sites from competitive research tools like SEM Rush, Compete.com, Keyword Spy, SpyFu, and Alexa to help get an overview of some of the top keywords competing sites are ranking for.


Crawl Their Site


Do you have a well optimized competitor? You can crawl their site using tools like Xenu Link Sleuth or Screaming Frog & then export the data to a spreadsheet, using that as a baseline to start your information architecture strategy from. Xenu is free & Screaming Frog's SEO Spider is free for up to a 500 URL site.



Keyword List Cleaner


If you have a big and dirty keyword list where some of the words have multiple meanings you can try to filter the list down by using negative keywords on a keyword list cleaner.


Google Related Searches


Whenever you search on Google not only does their search box recommend tightly related keywords (which are good for late state optimization of on-page content), but in the left column they have a link to "related searches" which organizes related keywords. Within these lists of keywords you can click further into to drill down deeper.




Some folks scrape that data in bulk as well, but if you do that then you are back to having to organize it again. ;)


Google AdWords Keyword Tool


Many paid keyword tools like Wordtracker have advanced filtering & organization options, but I mainly wanted to show free options in the post. Google AdWords keyword tool has multiple helpful ways to organize data.



I tried to highlight key areas & options in the above image, but it sorta feels like I highlighted everything, as there are so many amazing options baked into it. You can get keyword data based on selecting a category, a site, or entering a root keyword. They allow further filtering by match type, tight or loose keyword groupings, location, and so on. Sometimes the data can be a bit inaccurate, but nonetheless it is a great starting point as it really is an amazing feature-rich tool.


Microsoft adCenter Plug-in for Excel


Earlier I mentioned how Excel tables have a bunch of handy filters in them. Taking that to the next level, try the adCenter Excel plug in (review here), offering you quick access to Microsoft's keyword data by root keyword, general topical category, ad campaign association, and so on.


Your Web Analytics



There are at least 4 amazing benefits to using your site's keyword data


  • This is the stuff that actually applies directly to your site. Rather than being some sort of academic exercise or a bunch of "what if" sort of stuff where there is a big margin for error, you have the data related to the actual business impact of these keywords.
  • Since your site is already ranking for these keywords you already have momentum behind them. Pushing a #5 to #2 is typically far easier than going from nowhere to #5. And it is not only easier, but it is also more profitable.
  • This data is organized by page already, and (since you know your site) you should be able to quickly tell if pages that are ranking should be further optimized for a keyword or if the user intent for that keyword is different and it deserves a different page.
  • If you have been tracking your site for an extended period of time you should know not only what pages are ranking, but also why. Sure Google aims to make this a bit more complex, but that is precisely why looking at data on your own site is so helpful: you already know so much about it.

The same types of benefits can be had by using a (phrase matched, broad matched, or modified broad match / with negative keywords) AdWords ad campaign to do keyword research. You are not only testing the search volume of the keywords, but also how your site performs for them.


Visualize It


WordTracker's Strategizer (review here) is a premium SEO-oriented extension of web analytics data, which helps make the data relationships easier to visualize. Concentrate is another paid application built on data wrangling & visualization front.


Free keyword cloud tools like Wordle & tools like Many Eyes can also be valuable for helping you see word relationships for a page and convey concepts to management. You can probably guess which page the following analytics-driven word cloud is for without even visiting it. ;)



You could also put a URL in a keyword density tool, a page comparison tool, or a word cloud tool to view a page's on-page content that way. If it isn't too self-referential, ...


Categories: 

Generated by BlogIt

BlogIt - Auto Blogging Software for YOU!

BlogIt - autoblogging software for YOU

BlogIt - autoblogging software for YOU