RSS 5 projects tagged "crawler"

Download Website Updated 31 May 2010 ItSucks

Screenshot
Pop 87.21
Vit 4.60

ItSucks is a Web spider with the ability to download (and resume) files. It is also highly customizable with regular expressions and download templates. All backend functionality is also available in a separate library.

Download Website Updated 06 Apr 2014 OpenSearchServer

Screenshot
Pop 572.81
Vit 85.61

OpenSearchServer is a powerful, enterprise-class, search engine program. Using its Web user interface, crawlers (Web, file, database, etc.), and REST/RESTFul API, you can integrate advanced full-text search capabilities into your application.

No download Website Updated 11 Jun 2010 Ex-Crawler

Screenshot
Pop 23.49
Vit 1.03

The Ex-Crawler Project is divided into three subprojects. The main part is the Ex-Crawler daemon server, a highly configurable and flexible Web crawler written in Java. It comes with its own socket server, with which you can manage the server, users, distributed grid/volunteer computing, and much more. Crawled information is stored in a database (Currently MySQL, PostgreSQL, and MSSQL are supported). The second part is a graphical (Java Swing) distributed grid/volunteer computing client, including user computer state detection, based on JADIF Project. The Web search engine is written in PHP. It comes with a Content Management System, user language detection and multi-language support, and templates using Smarty, including an application framework that is partly forked from Joomla 1.5, so that Joomla components can be adapted quickly.

No download No website Updated 21 Nov 2010 skipfish

Screenshot
Pop 64.06
Vit 1.55

skipfish is a high-performance, easy, and sophisticated Web application security testing tool. It features a single-threaded multiplexing HTTP stack, heuristic detection of obscure Web frameworks, and advanced, differential security checks capable of detecting blind injection vulnerabilities, stored XSS, and so forth.

No download No website Updated 02 Apr 2012 mycelium

Screenshot
Pop 15.65
Vit 27.30

mycelium is an information retrieval system. It aspires to be an alternative to Nutch / Lucene. It uses MongoDB as a storage engine.

Screenshot

Project Spotlight

Phototonic

An image viewer and organizer.

Screenshot

Project Spotlight

Canari Framework

A Maltego rapid transform development framework.