wget_worker is a Perl script that uses wget to download from the Web in parallel. It supports URL filtering to download only URLs that match your pattern specified by Perl's regular expression.
|Tags||Internet FTP Web Archiving Mirroring|
|Operating Systems||POSIX Linux|
Release Notes: The centralized (master-slave) model algorithm has been selected as the main development path. Other miscellaneous changes were made.
Release Notes: A fix for non-English wget, a fix for the bug of "global" pattern matching (~= m/../../g) found in Perl 5.004_04, non-enforcement of forking, executing, file opening, and locking, checks for validity of Perl's regular expression before running, revision of the interpretation of %XX pattern in the URL, and other bugfixes.
Release Notes: Fixed the problem with special characters such as the ~ character.