AWbot is a bot that connects to your Web site and makes URL requests like human visitor. It's not a Web indexing robot, but a Web client tool that emulates visitors browsing your Web site to test its stability after a development change, its reliability, and its response to heavy loads.
PureTest is primarily targeted for function testing in the earlier phases of a development project. Even though it supports testing a variety of applications it is especially useful for debugging and snooping of Web applications. It includes a HTTP Recorder and Web Crawler which makes it useful for generic verification of HTTP requests and Web content checking.
Checky is a document validation and analysis extension for Firefox, Mozilla, and Netscape. It provides an easy-to-use interface to many free and commercial online validation and analysis services. It allows the user to validate, analyze, view, and inspect documents containing HTML, XHTML, CSS, RDF, RSS, XML, P3P, hyperlinks, metadata, and many more. It can check Section 508 and WAI compliance of documents with many helpful services. It can help in the design, development, and maintenance of accessible documents for a semantic web.
Furies is a Java-based Web site testing tool which relies on many Jakarta components. Its goal is to ensure a Web page is "correct" by running one or more conditions on it. The Furies distribution supplies some conditions and it is very easy to program your own. For accessing Web sites, Furies relies on HttpClient and configuration may be done programmatically or via Digester.
Advanced Web Ranking is a tool that will help you check your Web site position on all major search engines. It saves you hours of tedious work while monitoring your Web site's search engine position. It generates tabular and graphical reports that will help you check not just the position of your Web site, but the position of your competitors' Web sites as well.