[Ilugc] [OT] need of libraries for exploring websites (Python/PERL)

Raja Subramanian rajasuperman at gmail.com
Mon Dec 29 18:30:29 IST 2008


On Mon, Dec 29, 2008 at 5:34 PM, kish <realmailer at gmail.com> wrote:
> I wish to download a bunch of files from a site which allows directory
> listing
> with links like
...
> After which I can apply a filter to extract only those I need and pass
> the list to wget or the like

wget can probably do everything you are looking for.

Recursively fetch files (use with caution):
    http://www.gnu.org/software/wget/manual/wget.html#Recursive-Download

Use the include/exclude filters to selectively download files.

- Raja


More information about the ilugc mailing list