RUBiS is an auction site modeled after eBay.com used to benchmark e-commerce Web site technologies. It is currently used to evaluate design patterns, application servers, and communication layers scalability. Several implementations using PHP, Servlets, Enterprise JavaBeans (EB BMP, EB CMP, MDB, SB, EJB 2.0 CMP, Session Façade, etc.) are already available and new versions for JDO and .Net are currently developed.
HPC Challenge is a collection of benchmarks for measuring various aspects of system performance, such as flop/s, sustainable memory bandwidth, memory read/write rates, network bandwidth, and latency for parallel machines. It is designed for supercomputers, but will run on any computer with MPI-1 (Message Passing Interface) implementation and BLAS (Basic Linear Algebra Subprograms).
Spumoni provides an open framework for monitoring applications using SNMP. Specifically, it enables any program that can be queried via local commands to be health-checked by OpenNMS, Tivoli, OpenView, MRTG, RRDTool, and many others. This allows admins to employ enterprise-level monitoring capabilities for even non-SNMP-enabled applications.
XML Benchmark is a C/C++/Java XML parsers benchmarking toolset. Supported parsers include LibXML2, Xerces, Oracle XDK, Expat, RXP, QT, and Sun Crimson. Benchmarking fields include parsing (native, SAX, DOM), DOM manipulation, schema validation, XSL transformation, and XML signature and encryption.
tstime is a command that is similar to the time(1) command, but in addition to the runtime, it also prints the highwater memory usage (RSS+VMEM) of the controlled process. tsmon is a command that prints the runtime/highwater memory usage of every process that exits on the system until the tsmon is quit. These programs use the taskstats delay accounting interface of the Linux 2.6 kernel.
pmbw is a set of assembler routines to measure the parallel memory (cache and RAM) bandwidth of modern multi-core machines. Memory bandwidth is one of the key performance factors of any computer system. Today, measuring the memory performance often gives a more realistic view of the overall speed of a machine than pure arithmetic or floating-point benchmarks. pmbw contains a set of very basic functions which are all hand-coded in assembler to avoid any compiler optimizations. These basic functions are modeled after the basic inner loops found in any data processing, sequential scanning and pure random access. Any application will have a memory access pattern which is somewhere between these two extremes. The current version of pmbw supports benchmarking 16-, 32-, 64-, 128-, or 256-bit memory transfers on x86_32-bit, x86_64-bit, and ARMv6 systems.