GNU parallel is a shell tool for executing jobs in parallel locally or using remote computers. A job is typically a single command or a small script that has to be run for each of the lines in the input. The typical input is a list of files, a list of hosts, a list of users, a list of URLs, or a list of tables. If you use xargs today you will find GNU parallel very easy to use, as GNU parallel is written to have the same options as xargs. If you write loops in shell, you will find GNU parallel may be able to replace most of the loops and make them run faster by running several jobs in parallel. GNU parallel makes sure output from the commands is the same output as you would get had you run the commands sequentially. This makes it possible to use output from GNU parallel as input for other programs.
Ganglia is a scalable distributed monitoring system for high-performance computing systems such as clusters and grids. It is based on a hierarchical design targeted at federations of clusters. Ganglia is currently in use on over 500 clusters around the world and has scaled to handle clusters with 2000 nodes.
PVM (Parallel Virtual Machine) is a portable message-passing programming system, designed to link separate host machines to form a ``virtual machine'' which is a single, manageable computing resource. The virtual machine can be composed of hosts of varying types, in physically remote locations. PVM applications can be composed of any number of separate processes, or components, written in a mixture of C, C++ and Fortran. The system is portable to a wide variety of architectures, including workstations, multiprocessors, supercomputers and PCs.
OOMPI is an object-oriented interface to the MPI message passing library standard. It is used at a much higher level than the standard MPI C++ bindings, providing a full class library that takes advantage of many C++/object oriented abstractions for message passing. It is a thin layer that runs over any MPI-1.1 compliant C implementation.
distributed.net is a loosely knit group of computer users from all of the world that is taking up challenges requiring lots of computing power (most notably the RC5, DES, and OGR cracking contests). It is simple to participate in the challenges by downloading and running their client software (which uses idle CPU time to complete its tasks).
The Bioinformatics Benchmark System is an attempt to build a reasonable testing framework, tests, and data, to enable end users and vendors to probe the performance of their systems. It is not trying to be the last word in informatics benchmarking, as there are simply too many codes, tests, data sets, and databases. The goal is to create a core of tests that all may download and use to probe specific elements of system performance. The end goal is to enable a pluggable set of tests, including the core tests, so that performance data may be gathered.
Moab Workload Manager is a High Performance Computing (HPC) resource management and job scheduler. It is designed and developed by the same developers as the popular Maui Scheduler, and it provides the same powerful cluster scheduling capabilities with the addition of events, resources, and grid policy engines.
Xi-Batch is a very flexible job scheduling and workload management system. It provides time-based scheduling as well as load management, dependency-based job execution, and job prioritization. Each job's environment (environment variables and I/O default paths) is established by the system based on user ID. It can manage jobs in a single server or across a network of any number of servers, even different UNIX/Linux platforms. It can be controlled by CLI, a GUI (Motif), A Windows client, a Web-browser, or through an API. It works as an intelligent job dispatcher in grids or other server clusters.