Projects / YourAmigo Spider Linker

YourAmigo Spider Linker

Spider Linker provides the ability to efficiently make all content on a Web site, particularly dynamic content, available to Internet search engines. It discovers content on one or more Web sites, and creates a table of contents (TOC) of all the content in a format that is friendly to search engine spiders. HTML, XML, sitelist.txt, and Harvest Control List formats are supported, and custom formats can be constructed. Since it provides FTP, HTTP/HTTPS, upload, and email publishing mechanisms, it can also support XML feeds and other URL submission strategies.

Operating Systems

Recent releases

  •  21 Aug 2003 17:28

    No changes have been submitted for this release.


    Project Spotlight


    A Fluent OpenStack client API for Java.


    Project Spotlight

    TurnKey TWiki Appliance

    A TWiki appliance that is easy to use and lightweight.