Projects / WebLech

WebLech

WebLech is a Web site download tool written in Java, which supports many features required to download sites and emulate standard browser behavior as much as possible. It is multithreaded and comes with a GUI console.

Tags
Licenses
Operating Systems
Implementation

Recent releases

  •  10 Jun 2002 20:37

    Release Notes: This release has classification of URLs as "interesting" or "boring" by simple string matching. Interesting URLs are downloaded in preference to boring ones. Spider has been separated from the UI, and is now in ui/TextSpider. Checkpointing and resume functionality have been added so that the spider can be killed and restarted without doing lots of processing. URL retrieval has been fixed so that fragments (URLs with a # in them) are not treated as new URLs.

    •  21 Nov 2001 18:17

      Release Notes: Basic multi-threading code is now in place, so the spider can retrieve many URLs at once. There's no limit to the number of threads that can be started. Mailto links on pages are now handled without the spider crashing, and are saved into a text file for later processing.

      •  22 Oct 2001 03:20

        No changes have been submitted for this release.

        Screenshot

        Project Spotlight

        OpenStack4j

        A Fluent OpenStack client API for Java.

        Screenshot

        Project Spotlight

        TurnKey TWiki Appliance

        A TWiki appliance that is easy to use and lightweight.