12 projects tagged "Clustering Tools"
classh is yet another wrapper around ssh for running commands on a number of hosts concurrently. It is similar to xCAT, pssh, Cluster ssh, and a gaggle of other utilities. The only pre-requisite for classh is Python 2.4 or later, and no formal installation is required; a copy of the classh.py file is sufficient to run commands. The SSHJobMan class from classh can be used to create custom job management scripts. This class lets you either wait until all output has returned from a batch job or process the results as they become available by incrementally polling the running job. The output, error messages, exit code, and start and completion times of each job are stored in the results. It's been tested on jobs of over 25,000 hosts and handles over 10,000 hosts per hour across a WAN and without noticeable impact on the administrator's host.
BorderFlow implements a general-purpose graph clustering algorithm. It maximizes the inner to outer flow ratio from the border of each cluster to the rest of the graph. The main advantage of the algorithm is that it does not need parametrization to compute results of high accuracy.
ClusterShell is a set of tools and an event-based Python library to execute commands on local or remote cluster nodes in parallel. The framework also provides advanced methods for handling node sets and node groups to ease and improve administration of large compute clusters or server farms. Three convenient command line utilities, clush, clubak, and nodeset, allow traditional shell scripts to benefit some useful features offered by the library.
pexconfig allows you to use a PXE-enabled network card as the first boot device for a system. This software suite also includes PXE-menu tools, which are used to control the booting of networked computers directly from the computer's console at the BIOS level before any operating system has been loaded. The menus provided by these tools can be used for diagnostic purposes, for firmware upgrades, or for selecting an operating system installation method.
The pbs_python package is a wrapper class for the Torque Batch System C library. With this package, you now can write utilities and extensions in Python instead of C. This package was developed to replace xpbsmon by an ASCII version named pbsmon. PBSQuery is also included in this package. This is a Python module built on top of the pbs Python module to simplify querying the batch server. There are a lot of examples included in the source package.
Sequencer is an engine used by system administrators for the computation and execution of sequences of actions over hardware or software. It can ping various devices in parallel, power on your whole cluster, or generate an Emergency PowerOff (EPO) script for your data center or cluster. It takes into account various dependencies (power off nodes before switches, clients before server), deals with failures kindly, and is very efficient (>4000 nodes in less than 10 minutes).
Galera wsrep provider is a dlopenable generic replication library which implements the wsrep provider API. It provides very efficient synchronous replication, and multi-master and "parallel applying" capabilities for opaque data buffers. Its primary focus is data consistency. A transaction is either applied on every node, or not at all. It works anywhere TCP works, including on WAN, and can utilize UDP multicast where available. It is used by the MySQL-wsrep patch project to create true multi-master MySQL/InnoDB clusters.