RUBiS is an auction site modeled after eBay.com used to benchmark e-commerce Web site technologies. It is currently used to evaluate design patterns, application servers, and communication layers scalability. Several implementations using PHP, Servlets, Enterprise JavaBeans (EB BMP, EB CMP, MDB, SB, EJB 2.0 CMP, Session Façade, etc.) are already available and new versions for JDO and .Net are currently developed.
The Router Audit Tool (rat) downloads configurations of router devices running IOS to be audited, and then checks them against the settings defined in the benchmark. For each configuration examined, it produces a report listing the following: a list of each rule checked with a pass/fail score, a raw overall score, a weighted overall score (1-10), and a list of IOS commands that will correct problems identified.
SLAMD is a Java application designed for stress testing and performance analysis of network-based applications. Although it was originally designed for benchmarking directory servers, it is actually very flexible and can be used to test applications using a wide range of protocols like LDAP, HTTP, POP, IMAP, and SMTP, and can also interact with relational databases using JDBC. In addition, it provides a Java-based API for developing custom workloads, and a scripting engine and record and playback tools that may also be used in the load generation process.
Siege is a regression test and benchmark utility. It can stress test a single URL with a user defined number of simulated users, or it can read many URLs into memory and stress them simultaneously. The program reports the total number of hits recorded, bytes transferred, response time, concurrency, and return status. Siege supports HTTP/1.0 and 1.1 protocols, GET and POST directives, cookies, transaction logging, and basic authentication. Its features are configurable on a per user basis.
SmokePing is a network latency monitor. It measures network latency to a configurable set of destinations on the network, and displays its findings in easy-to-read Web pages. SmokePing has support for distributed monitoring as well as for dealing with dynamic IP addresses. SmokePing uses RRDtool as its logging and graphing back-end, making the system very efficient. The presentation of the data on the Web is done through a CGI with some AJAX capabilities for interactive graph exploration.
Spumoni provides an open framework for monitoring applications using SNMP. Specifically, it enables any program that can be queried via local commands to be health-checked by OpenNMS, Tivoli, OpenView, MRTG, RRDTool, and many others. This allows admins to employ enterprise-level monitoring capabilities for even non-SNMP-enabled applications.