RSS 1 project tagged "Erlang"

Download Website Updated 30 Dec 2010 Ebot

Screenshot
Pop 102.81
Vit 3.28

Ebot is a scalable and distribuited Web crawler. The URLs are saved to a NOSQL database (which supports map/reduce queries) that you can query via RESTful HTTP requests or using your preferred programming languages. The URLs that need to be analyzed are sent to AMQP queues. In this way, it is possible to run several crawlers in parallel and stop and start them without losing URLs.

Screenshot

Project Spotlight

quadtree

A Thread-safe quad tree C library.

Screenshot

Project Spotlight

dos2unix

Utilities for converting text files from DOS/Mac format to Unix format and vice versa.