OSDB, the open source database benchmark, is intended for the use of system and database developers, providing a significant chunk of benchmark code that can be used, tailored, and tweaked according to local needs. It is derived from AS3AP (ANSI SQL Standard and Portable Benchmark); its most important change is the segmentation of the benchmark, allowing developers to concentrate on the results that are most relevant to their work.
PureLoad is a load testing tool that simulates thousands of users executing requests against server based applications. It can be used to verify that your application will meet the expected performance criteria. PureLoad reports quality and performance problems, as well as detailed statistics gathered during a load test. PureLoad also includes extensive support for easy recording and testing of Web-based applications. The HTTP Recorder ease the process of capturing HTTP and HTTPS requests into PureLoad scenarios. The Web Crawler is used to scan a static Web site for general errors, and it can also be used to generate PureLoad scenarios to be used in a load test.
This small tool connects to the P6Spy JDBC logger and displays in real time the queries going to the database. It uses an integrated SQL parser to build statistics on the most accessed tables and columns to enable database index creation. Other information is also gathered and displayed, such as the request time for a single request, for a class of request, and for all the requests. Sorting may be done on these views to detect database problems efficiently.
RUBiS is an auction site modeled after eBay.com used to benchmark e-commerce Web site technologies. It is currently used to evaluate design patterns, application servers, and communication layers scalability. Several implementations using PHP, Servlets, Enterprise JavaBeans (EB BMP, EB CMP, MDB, SB, EJB 2.0 CMP, Session Façade, etc.) are already available and new versions for JDO and .Net are currently developed.
The Java Application Monitor (JAMon) is a free, simple, high performance, thread safe, Java API that allows developers to easily monitor production applications. JAMon can be used to determine application performance bottlenecks, user/application interactions, and application scalability. JAMon gathers summary statistics such as hits, execution times (total, average, minimum, maximum, standard deviation), and simultaneous application requests. JAMon statistics are displayed in the sortable JAMon report.
Tsung is a distributed load testing tool. It is protocol-independent and can currently be used to stress HTTP, WebDAV, PostgreSQL, MySQL, LDAP, AMQP, and XMPP/Jabber servers. It simulates user behavior using an XML description file, reports many measurements in real time (statistics can be customized with transactions, and graphics generated using gnuplot). For HTTP, it supports 1.0 and 1.1, has a proxy mode to record sessions, supports GET, POST, PUT, and DELETE methods, cookies, and basic/digest authentication. It also has support for SSL, WebSocket, and BOSH.