Web crawler to track price changes of a number of websites?

  • Nouvelle Vietnam
  • Newbie
  • Newbie
  • No Avatar
  • Joined: Jan 23, 2009
  • Posts: 5
  • Status: Offline

Post February 22nd, 2009, 3:38 am

Hey all, I'm thinking of setting up a website which can send out web crawlers to a number of computer parts websites and then collect the data and display it on my own website (name of the computer parts + the price associated). This is done so that people can take a look at the website and determine the cheapest price for the same component offered on a number of websites.

Any suggestion for a web crawler that can do something like this? The crawler should also be able to track the websites about four times a day.

NV.
  • Anonymous
  • Bot
  • No Avatar
  • Joined: 25 Feb 2008
  • Posts: ?
  • Loc: Ozzuland
  • Status: Online

Post February 22nd, 2009, 3:38 am

  • Don2007
  • Web Master
  • Web Master
  • No Avatar
  • Joined: Nov 21, 2006
  • Posts: 4924
  • Loc: NY
  • Status: Offline

Post February 22nd, 2009, 6:31 am

Isn't that what pricegrabber.com does? I don't know what kind of engine they use.
How do you know when a politician is lying? His mouth is moving.
  • Nouvelle Vietnam
  • Newbie
  • Newbie
  • No Avatar
  • Joined: Jan 23, 2009
  • Posts: 5
  • Status: Offline

Post February 22nd, 2009, 1:58 pm

Yes, but I want a similar service local to a country.
  • Don2007
  • Web Master
  • Web Master
  • No Avatar
  • Joined: Nov 21, 2006
  • Posts: 4924
  • Loc: NY
  • Status: Offline

Post February 22nd, 2009, 5:31 pm

What you want is called a shopping bot.

http://www.filebuzz.com/files/Shopping_Bots/1.html
How do you know when a politician is lying? His mouth is moving.
  • Nouvelle Vietnam
  • Newbie
  • Newbie
  • No Avatar
  • Joined: Jan 23, 2009
  • Posts: 5
  • Status: Offline

Post February 24th, 2009, 1:01 am

Any specific suggestion from that?
  • Don2007
  • Web Master
  • Web Master
  • No Avatar
  • Joined: Nov 21, 2006
  • Posts: 4924
  • Loc: NY
  • Status: Offline

Post February 24th, 2009, 7:40 am

No, I never used any of them.
How do you know when a politician is lying? His mouth is moving.
  • HarveyT
  • Born
  • Born
  • No Avatar
  • Joined: May 15, 2009
  • Posts: 1
  • Status: Offline

Post May 15th, 2009, 1:09 pm

Don2007 wrote:
No, I never used any of them.


NONE of those scripts on that page do what Nouvelle asked. Did you just Google a phrase and plop the link in there? Junk. Sorry, but it's a junk answer. Then you topped it off with, "No, I never used any of them."

Post Information

  • Total Posts in this topic: 7 posts
  • Users browsing this forum: No registered users and 67 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
 

© 2011 Unmelted, LLC. Ozzu® is a registered trademark of Unmelted, LLC.