The Cacheability Engine will check a URL you feed it for several things that will affect a Web cache, including web server clock skew, expires and Cache-Control headers, Last-Modified date presence, validation of LM date, Content-Length presence and more. It makes it easy to see how a cache will treat your content. There are also public engines running, so you don't have to install the software to use it for Internet-available sites.
GCache is a Python module that provides a generic cache class useful for speeding up any application where objects are referenced by keys. It uses object metadata to optimize hit-rates and freshness for fetches, and uses a "write-through" mechanism for writes and deletes. It can use "if-modified-since" fetches or rsync delta updates to refresh stale cached objects. GSource classes are provided for generating useful metadata from common sources (os.stat calls and MIME headers). A simple example urlCache is implemented that supports HTTP 1.1 (rfc2616) cache-control and expire headers to ensure freshness. Also included is an rfc2616 package useful for parsing HTTP 1.1 headers, and a PCache package implementing a persistant cache using a Python shelve.
Grail is an extensible Internet browser written entirely in the interpreted object-oriented programming language Python. It runs on Unix, and, to some extent, on Windows and Macintosh. Grail is easily extended to support other new protocols or file formats. Grail is distributed in source form, free of change, without warranties. It requires recent versions of Python and Tcl/Tk to run.
httpMonitor is a Python program which lets you monitor the HTTP traffic between a browser and a Web server. You configure your browser to use httpMonitor as its proxy to ensure that all HTTP traffic between browser and server goes via httpMonitor. In a XML-configuration file you can specify a Python-function as processor for the HTTP-messages you are interested in (requests or responses, which match certain criteria). You may have as many processors as you want, without modifying the actual program. The only thing you need to do is configure the httpMonitor and write your processors.
With LinkChecker, you can check HTML documents and Web sites for broken links. It features recursion, robots.txt exclusion protocol support, HTTP proxy support, i18n support, multithreading, regular expression filtering rules for links, and user/password checking for authorized pages. Output can be colored or normal text, HTML, SQL, CSV, or a sitemap graph in DOT, GML, or XML format. Supported link types are HTTP/1.1 and 1.0, HTTPS, FTP, mailto:, news:, nntp:, Telnet, and local files.
Load is a utility for Web application and SOAP-based Web services performance and scalability testing. It features a scripting language and a library of test objects for the creation of intelligent agents that drive the Web application or SOAP-based Web service. Running hundreds of agents concurrently shows how your software performs in production environments. Load is a Java application that runs on Linux, Solaris, NT, Win2000, and Macintosh. While Load continues to be maintained, the next generation is the TestMaker program.