All releases of crawl
Release Notes: Crawling is more reliable, and crawl performance has improved for large crawls.
Release Notes: A complete rewrite for higher performance, including support for all media types, asynchronous DNS lookups, and optional wait time between hosts. The configuration file specifies permittable size of media objects depending on media-type, etc.
Release Notes: This release has portability fixes, and supports downloading of media types other than just images.
Release Notes: This release fixes a bug where crawl would stop early when encountering errors on subsequent connections. The verbosity level and number of concurrent connections are tunable now
No changes have been submitted for this release.
