Related Keywords Scraper for PPV

by imrat on July 28, 2010

I love to make myself redundant. Thats why I always look to automate before I outsource.

On my journey to Ditch my Dayjob, I am now making some good progress. Adsense, SEO, PPC and PoF revenue streams are in place.

So Whats Next…

…PPV (Pay Per View) or also known as CPV (Cost Per View).

In PPC its all about finding the keywords that convert. On PoF its about the Demographics. In PPV it seems….URL’s and Keywords are key.

So I am creating my own URL scraper.

“Not another scraper!!”

I know that many already exist, but most of them are limited.

They are limited to just scraping google, bing and yahoo for the main keyword.

I want to go beyond that and build something that finds the unique profitable URLs that no one else is targetting.

Phase 1

As a first component to this new scraper I want to be able to give a theme keyword, and get a list of related terms. I have build it in Yahoo Pipes and Dapper, and currently gets related keywords from Google, Bing, and Search.com.

Example: Make Money

Below are the first 20ish related terms for the keyword “make money”:

  • ways to make money
  • money making ideas
  • make money online
  • make extra money
  • make money fast
  • project payday
  • jobs
  • work from home
  • adsense
  • home business
  • free money
  • easy money
  • save money
  • win money
  • i need money
  • make your own website
  • make up games
  • make your own myspace layout
  • make millions
  • make me a supermodel
  • Google Checkout
  • Ways to Make Money
  • Make Money Free
  • Make Money Fast

Here is the Yahoo Pipe for the scraper.

Phase 2: Get URLs

The next phase will be to use the related keywords and grab a bunch of URLs for these. It will do the expected (Google, Bing, Yahoo) but I also want it to do the unexpected ;)

Phase 3: Turn it into an online tool

Following phase 2, no doubt you want access to it. So I will build a quick web front end that will spit out a nice table of URLs and a downloadable CSV file.

What would you like to see me implement in this tool?

{ 2 comments }

1 Weezy August 18, 2010 at 16:17

yeah man that would be nice

2 imrat August 22, 2010 at 22:38

thanks for checking the blog Weezy. Anything specific that you would like to see in the scraper tool?

blog comments powered by Disqus

Previous post:

Next post: