wget_worker is a Perl script that uses wget to download from the Web in parallel. It supports URL filtering to download only URLs that match your pattern specified by Perl's regular expression.
| Tags | Internet FTP Web Archiving Mirroring |
|---|---|
| Licenses | GPL |
| Operating Systems | POSIX Linux |
| Implementation | Perl |
Recent releases


Release Notes: The centralized (master-slave) model algorithm has been selected as the main development path. Other miscellaneous changes were made.


Release Notes: A fix for non-English wget, a fix for the bug of "global" pattern matching (~= m/../../g) found in Perl 5.004_04, non-enforcement of forking, executing, file opening, and locking, checks for validity of Perl's regular expression before running, revision of the interpretation of %XX pattern in the URL, and other bugfixes.


Release Notes: Fixed the problem with special characters such as the ~ character.