All releases of Larbin
Release Notes: This release corrects some compilation tweaks with recent gcc versions, improves the configuration file parser, and adds new options for following links selectively.
Release Notes: This release compiles on Solaris, cookie management has been added, images can be fetched with pages, and many rewrites have been done for efficiency and portability.
Release Notes: With this release, it is possible again to crawl through a proxy, all configurations should compile (Linux and BSD), images can now be downloaded with pages, and the robots.txt parser has been enhanced.
Release Notes: Many efficiency updates were made to the sequencer, to buffer recycling, and to DNS management. A new output module for statistics has been added.
Release Notes: Output and buffer interfaces have been simplified. A dynamic buffer option has been added. The web server has been reworked.
Release Notes: New features include FreeBSD compatibility, bandwidth management, the ability to save very big files without using more memory, and fancy histograms for statistics.
Release Notes: Ability to save files and keep the directory structure of sites, and some bugfixes.
Release Notes: A footprint filter, which prevents similar pages from being fetched twice, was added.
Release Notes: poll() is now used instead of select() for allowing more simultaneous connections. Fetched pages can now be saved on disk.
Release Notes: More configuration options (mainly to avoid threads or disk overhead when not needed).
