Web crawler to track price changes of a number of websites?

  • Nouvelle Vietnam
  • Newbie
  • Newbie
  • Nouvelle Vietnam
  • Posts: 5

Post 3+ Months Ago

Hey all, I'm thinking of setting up a website which can send out web crawlers to a number of computer parts websites and then collect the data and display it on my own website (name of the computer parts + the price associated). This is done so that people can take a look at the website and determine the cheapest price for the same component offered on a number of websites.

Any suggestion for a web crawler that can do something like this? The crawler should also be able to track the websites about four times a day.

NV.
  • Anonymous
  • Bot
  • No Avatar
  • Posts: ?
  • Loc: Ozzuland
  • Status: Online

Post 3+ Months Ago

  • Don2007
  • Web Master
  • Web Master
  • Don2007
  • Posts: 4924
  • Loc: NY

Post 3+ Months Ago

Isn't that what pricegrabber.com does? I don't know what kind of engine they use.
  • Nouvelle Vietnam
  • Newbie
  • Newbie
  • Nouvelle Vietnam
  • Posts: 5

Post 3+ Months Ago

Yes, but I want a similar service local to a country.
  • Don2007
  • Web Master
  • Web Master
  • Don2007
  • Posts: 4924
  • Loc: NY

Post 3+ Months Ago

What you want is called a shopping bot.

http://www.filebuzz.com/files/Shopping_Bots/1.html
  • Nouvelle Vietnam
  • Newbie
  • Newbie
  • Nouvelle Vietnam
  • Posts: 5

Post 3+ Months Ago

Any specific suggestion from that?
  • Don2007
  • Web Master
  • Web Master
  • Don2007
  • Posts: 4924
  • Loc: NY

Post 3+ Months Ago

No, I never used any of them.
  • HarveyT
  • Born
  • Born
  • HarveyT
  • Posts: 1

Post 3+ Months Ago

Don2007 wrote:
No, I never used any of them.


NONE of those scripts on that page do what Nouvelle asked. Did you just Google a phrase and plop the link in there? Junk. Sorry, but it's a junk answer. Then you topped it off with, "No, I never used any of them."

Post Information

  • Total Posts in this topic: 7 posts
  • Users browsing this forum: No registered users and 66 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
 

© 1998-2014. Ozzu® is a registered trademark of Unmelted, LLC.