[SATLUG] wget frustration

Daniel Givens daniel at rugmonster.org
Fri May 23 07:48:44 CDT 2008


On Fri, May 23, 2008 at 6:57 AM, Geoff <geofff at w5omr.shacknet.nu> wrote:
> I wish it -was- as simple as 'wget
> http://path/to/desired/files/*.extention' but it's not.

On sites that have directory indexes turned on, it is that simple. An
example would be to look at what's displayed at the following URL:

http://www.kernel.org/pub/linux/kernel/v2.6/

That page is generated by the web server based on the contents of that
directory on the server. Let's say you wanted every released version
of the 2.6 kernel source that's in .bz2 format. Because directory
indexes are enabled, you can use:

wget -r -A bz2 http://www.kernel.org/pub/linux/kernel/v2.6/

Note the -r which tells wget to act recursively. Also, if you don't
want an identical directory structure created,
./www.kernel.org/pub/linux/kernel/v2.6/ in this case, you need to add
the -nd (--no-directories).

wget only knows what to download from the kernel.org page because when
it goes to the provided URL, it gets a server generated index.html
with links to the files. If those links didn't exist, wget would have
no idea they existed. That's the case with the Akamai site. There are
no indications that those files exist by simply going to the URL for
the directory where your one known mp3 resides.

I would suggest you look into getting hooked up with the actual RSS
feed and use a podcasting application. You can only hope they include
a nice long history of previous shows in the feed. Of course, you
could spend your Memorial Day weekend Googling for archives.

Take care and have a great weekend!

Daniel


More information about the SATLUG mailing list