Projects / wget_worker

wget_worker

wget_worker is a Perl script that uses wget to download from the Web in parallel. It supports URL filtering to download only URLs that match your pattern specified by Perl's regular expression.

Tags
Licenses
Operating Systems
Implementation

Recent releases

  •  30 Jan 2001 08:27

    Release Notes: The centralized (master-slave) model algorithm has been selected as the main development path. Other miscellaneous changes were made.

    •  15 Mar 2000 18:42

      Release Notes: A fix for non-English wget, a fix for the bug of "global" pattern matching (~= m/../../g) found in Perl 5.004_04, non-enforcement of forking, executing, file opening, and locking, checks for validity of Perl's regular expression before running, revision of the interpretation of %XX pattern in the URL, and other bugfixes.

      •  28 Feb 2000 06:34

        Release Notes: Fixed the problem with special characters such as the ~ character.

        Screenshot

        Project Spotlight

        OpenStack4j

        A Fluent OpenStack client API for Java.

        Screenshot

        Project Spotlight

        TurnKey TWiki Appliance

        A TWiki appliance that is easy to use and lightweight.