2 projects tagged "web crawler"
Updated 13 Jun 2009
Smart Cache Loader
| Pop | 73.81 |
|---|---|
| Vit | 4.66 |
Smart Cache Loader is a very configurable Web grabber with special Smart Cache support.
Updated 18 Nov 2012
SpiderBot
| Pop | 21.19 |
|---|---|
| Vit | 13.63 |
SpiderBot crawls the Web, retrieves content, and performs actions on the content. It is an effort to design and develop a truly pipelined distributed Web crawler.
