Voting Chart

Total votes : 5

Assuming you downloaded and tested wget...did you find it useful?

Poll ended at January 26th, 2004, 3:15 pm.

  •  
    Yes
  •  
    No

Introducing wget

  • rjmthezonenet
  • Expert
  • Expert
  • User avatar
  • Posts: 526
  • Loc: St. John's, Newfoundland, Canada

Post 3+ Months Ago

It may be fun to compare some of the odd-ball utilities we tend to use as web masters. You know, the kind of ones people don't usually search for, but can't stop using once they find them. Think of it as show and tell. :)

Today I will introduce wget

wget is licenced under the GNU General Public Licence. This means, in simple terms, that it is free!

Wget retrieve files using HTTP and FTP. It works non-interactively, so it can work in the background (a plus for scheduled tasks). The program supports recursive retrieval which means you can use wget to make mirrors of archives and home pages or to travel the Web like a WWW robot.

Wget works particularly well with slow or unstable connections by continuing to retrieve a document until the document is fully downloaded. Re-getting files from where it left off works on servers (both http and ftp) that support it. Both http and ftp retrievals can be time stamped, so wget can see if the remote file has changed since the last retrieval and automatically retrieve the new version if it has.

I prefer to use wget to snatch entire copies of web sites, or to download specific files without my web browsers plug-ins getting in the way.

To download an entire web site:
wget --mirror http://www.website.com/

To download a single file:
wget http://www.website.com/directory/file.zip

This utility is ported to a number of operating systems including UNIX and Windows.
  • Anonymous
  • Bot
  • No Avatar
  • Posts: ?
  • Loc: Ozzuland
  • Status: Online

Post 3+ Months Ago

  • Axe
  • Genius
  • Genius
  • User avatar
  • Posts: 5739
  • Loc: Sub-level 28

Post 3+ Months Ago

Oh, I've been using wget for years, it rules :)

favourite usage...

Code: [ Select ]
screen wget -c -i files.txt


Then just hit CTRL+a, then d, and close the SSH session.. screen is another lil linux function, and may or may not be included depending on the distro you use. To resume the screen session, simply use

Code: [ Select ]
screen -r


It can get a lil more complex than that if you have multiple screen sessions, but another very handy lil app (especially if you access your Linux account from several different machines and want to simply be able to resume where you left off, or run something in the background without having to stay connected the whole time).

files.txt just contains a list of URLs of files I wish to download...

Can be very handy, especially if it's large files - I use it a lot to download game addons/patches/maps, work from clients, etc.

Then once it's all together in a central location (my Linux box), I just Xfer it over the LAN to the windows machine.
  • rjmthezonenet
  • Expert
  • Expert
  • User avatar
  • Posts: 526
  • Loc: St. John's, Newfoundland, Canada

Post 3+ Months Ago

Would somebody like to start another thread and introduce a different utility?

Post Information

  • Total Posts in this topic: 3 posts
  • Users browsing this forum: No registered users and 48 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
 

© 1998-2014. Ozzu® is a registered trademark of Unmelted, LLC.