3 projects tagged "web crawler"
Updated 13 Jun 2009
Smart Cache Loader
| Pop | 74.46 |
|---|---|
| Vit | 4.66 |
Smart Cache Loader is a very configurable Web grabber with special Smart Cache support.
Updated 02 May 2013
OpenSearchServer
| Pop | 951.28 |
|---|---|
| Vit | 58.24 |
OpenSearchServer is a stable, high-performance search engine and a suite of high-powered full text search algorithms. Documents can be indexed in sixteen languages. Multi-lingual analyzers slice sentences into words, then run lemmatisation algorithms on words based on the document's language. Numerous document formats are supported, such as XML, HTML/XHTML, PDF, Word, PowerPoint, RTF, OpenOffice, plain text, MP3/4, Ogg, FLAC, etc. The Web interface, built around the Zkoss framework, provides an easy way to manage OSS. The integration is fast using the PHP client or the API (XML over HTTP). The crawlers of OpenSearchServer go through Web sites, file systems, and databases to rapidly and easily build your index.
Updated 18 Nov 2012
SpiderBot
| Pop | 21.31 |
|---|---|
| Vit | 13.48 |
SpiderBot crawls the Web, retrieves content, and performs actions on the content. It is an effort to design and develop a truly pipelined distributed Web crawler.
