Projects / YourAmigo Spider Linker

YourAmigo Spider Linker

Spider Linker provides the ability to efficiently make all content on a Web site, particularly dynamic content, available to Internet search engines. It discovers content on one or more Web sites, and creates a table of contents (TOC) of all the content in a format that is friendly to search engine spiders. HTML, XML, sitelist.txt, and Harvest Control List formats are supported, and custom formats can be constructed. Since it provides FTP, HTTP/HTTPS, upload, and email publishing mechanisms, it can also support XML feeds and other URL submission strategies.

Tags
Licenses
Operating Systems
Implementation

Recent releases

  •  21 Aug 2003 17:28

    No changes have been submitted for this release.

    Screenshot

    Project Spotlight

    OpenStack4j

    A Fluent OpenStack client API for Java.

    Screenshot

    Project Spotlight

    TurnKey TWiki Appliance

    A TWiki appliance that is easy to use and lightweight.