50 projects tagged "Clustering/Distributed Networks"
distributed.net is a loosely knit group of computer users from all of the world that is taking up challenges requiring lots of computing power (most notably the RC5, DES, and OGR cracking contests). It is simple to participate in the challenges by downloading and running their client software (which uses idle CPU time to complete its tasks).
esky is an implementation of job freezing (checkpoint/resume) for Unix processes. It can save the state of a running process to disk then later resume it from the point it left off, possibly on a different machine. esky currently works on a limited but non-trivial range of processes. esky can cope with programs that open or mmap() files, including opening shared libraries with dlopen(). esky is implemented entirely in userspace - no kernel patches or modules are required. It works under Linux 2.2 and Solaris 2.6 and is written to be independent of CPU type.
LAM/MPI is an implementation of the Message Passing Interface (MPI) parallel standard that is especially friendly to clusters. It includes a persistent runtime environment for parallel programs, support for all of MPI-1, and a good chunk of MPI-2, such as all of the dynamic functions, one-way communication, C++ bindings, and MPI-IO.
OOMPI is an object-oriented interface to the MPI message passing library standard. It is used at a much higher level than the standard MPI C++ bindings, providing a full class library that takes advantage of many C++/object oriented abstractions for message passing. It is a thin layer that runs over any MPI-1.1 compliant C implementation.
PVM (Parallel Virtual Machine) is a portable message-passing programming system, designed to link separate host machines to form a ``virtual machine'' which is a single, manageable computing resource. The virtual machine can be composed of hosts of varying types, in physically remote locations. PVM applications can be composed of any number of separate processes, or components, written in a mixture of C, C++ and Fortran. The system is portable to a wide variety of architectures, including workstations, multiprocessors, supercomputers and PCs.
Pyslice provides utility functions for parametric modeling. It creates data sets based on a configuration file and a series of template files, then runs a model against each data set. It tracks each model's progress, keeping the total number of concurrent model runs under a limit established by the user. It is useful for running many model runs on a Beowulf cluster, or for control of the model runs on single processor machines. It can also monitor the model runs through an internal queue, or place the modeling jobs into a queue managed by other software. It is written in Python.
myBeasties is a highly flexible evolutionary programming module. It is designed to be extendable and customisable for maximum use by the Perl developer. Many species of genotypes can be evolved, and these can be used to build phenotypes of any size or complexity. These can be as simple as a list or as large as a whole class of objects.
Warewulf is an operating system management toolkit designed to facilitate large scale deployments of homogeneous and heterogeneous systems on physical, virtual and cloud based infrastructures. Originally, the Warewulf project pioneered the concept of stateless computing in HPC, setting the standard for large-scale cluster provisioning. It provided two functions, provisioning and monitoring but the two functions did not communicate within Warewulf itself, nor was it possible to hook other functions directly into Warewulf itself. Today, Warewulf is more than just a basic provisioning and monitoring solution as it now implements an abstract, object-oriented data store and a modular interface that facilitates a highly extensible, customizable feature set. Current and planned modules include monitoring (operating system, services, filesystems, etc.), provisioning, power management, user management, configuration management, event/trigger handling and notification, scheduler integration, cloud services (both local and remote), etc.
C++ template classes implementing a B+ tree key/data container in main memory.