Release Notes: The threading algorithm has been improved, and all previously known race conditions have been fixed. A new option --cookiefile parses initial cookie data to be sent to HTTP servers. The "Crawl-delay" option of robots.txt files is now supported. The --pause option only waits between two requests to the same server, not between all requests. DNS lookups for HTTP servers are now cached. The output for the DOT graph format has been fixed. URLs with invalid syntax are now cached and are matched by the --ignore-url option.
Release Notes: HTML image srcset and schema itemtypes as well as HTTP "Link:" headers are now parsed and checked. Bugs with external robots.txt parsing have been fixed.
Release Notes: XML Sitemap files are now checked and parsed. A new HTTP header info plugin has been added. Bugs with debug output, SSL checking, and result caching have been fixed.
Release Notes: This release adds plugin support and uses the Python requests module for HTTP URLs. Some bugs were also fixed.
Release Notes: This release adds missing logger classes and sends an HTTP Accept header.
Release Notes: This release makes per-host connection limits configurable and avoid a DoS in the SSL certificate host matcher. Some bugs have also been fixed.