2 projects tagged "web crawling"

No download No website Updated 25 Jun 2009 Methanol

Screenshot
Pop 30.10
Vit 1.01

Methanol is a modular, customizable Web crawling system with crawlers optimized for speed. It is designed to allow the administrator to set up any kind of filetype handling, parsing, and indexing rules.

Download Website Updated 06 Apr 2014 OpenSearchServer

Screenshot
Pop 558.69
Vit 40.14

OpenSearchServer is a powerful, enterprise-class, search engine program. Using its Web user interface, crawlers (Web, file, database, etc.), and REST/RESTFul API, you can integrate advanced full-text search capabilities into your application.

Screenshot

Project Spotlight

stream

A Dart Web server.

Screenshot

Project Spotlight

Podget

A simple podcast aggregator.