17 projects tagged "parallel"

Download Website Updated 22 May 2014 GNU Parallel

Screenshot
Pop 696.05
Vit 125.79

GNU parallel is a shell tool for executing jobs in parallel locally or using remote computers. A job is typically a single command or a small script that has to be run for each of the lines in the input. The typical input is a list of files, a list of hosts, a list of users, a list of URLs, or a list of tables. If you use xargs today you will find GNU parallel very easy to use, as GNU parallel is written to have the same options as xargs. If you write loops in shell, you will find GNU parallel may be able to replace most of the loops and make them run faster by running several jobs in parallel. GNU parallel makes sure output from the commands is the same output as you would get had you run the commands sequentially. This makes it possible to use output from GNU parallel as input for other programs.

No download Website Updated 23 May 2009 Consh

Screenshot
Pop 18.36
Vit 42.80

Consh is a set of programs that can turn one or more UNIX hosts on a trusted LAN into a singular Bourne shell multi-computer on which shell scripts are run concurrently. The service abstracts hosts into what appears to be shell process with a fixed number of threads or workers, to which work may be assigned and results received concurrently. It includes utilities that assign commands to workers in parallel and a command that initiates distributed barriers between workers for synchronization purposes. Environment variables can be set on a per-host basis to implement locking mechanisms like semaphores or ticket algorithms. Daemons can delegate work to one another as needed.

No download No website Updated 08 Mar 2010 PupyMPI

Screenshot
Pop 16.37
Vit 39.28

PupyMPI is a generic 100% Python MPI implementation. It aims to cover most of the MPI 1.3 API specifications, but pays less attention to performance.

No download No website Updated 16 Dec 2010 OpenMPF

Screenshot
Pop 15.72
Vit 35.50

OpenMPF is a library for solving large, dense, multi-RHS linear systems. It is based on MPI/openMP parallelism, and relies on BLAS/LAPACK/MUMPS for the single node computations. It implements direct and iterative solvers, out-of-core matrices and vectors, and is easily accessible through a Python interface.

No download No website Updated 05 Jan 2011 Elemental

Screenshot
Pop 21.77
Vit 35.22

Elemental is a C++ framework for distributed-memory dense linear algebra that strives to be fast, portable, and programmable. It can be thought of as a generalization of PLAPACK to element-by-element distributions that also makes use of recent algorithmic advances from the FLAME project. Elemental usually outperforms both PLAPACK and ScaLAPACK, however, it heavily relies on MPI collectives so a good MPI implementation is crucial. Both pure MPI and hybrid OpenMP-MPI configurations are supported.

Download Website Updated 15 Sep 2013 Shard-Query

Screenshot
Pop 22.49
Vit 16.00

Shard-Query uses partitioning and sharding to add query parallelism and grid computing capabilities to MySQL. Multiple interfaces are included, from a commandline client to an object oriented interface to a MySQL proxy interface for nearly-completely transparent access to a sharded data set.

Download Website Updated 06 Jun 2013 Moscrack

Screenshot
Pop 80.83
Vit 5.79

Moscrack is a WPA cracker for use on clusters. It supports MOSIX, SSH, and RSH connectivity and works by reading a word list from STDIN or a file, breaking it into chunks, and passing those chunks off to separate processes that run in parallel. The parallel processes are then executed on different nodes in your cluster. All results are checked and recorded on your master node. Logging and error handling are taken care of. It is capable of running reliably for long periods of time, without the risk of losing data or having to restart. Moscrack uses aircrack-ng by default. Pyrit for WPA cracking and Dehasher for Unix password hashes are supported via plugins.

Download Website Updated 27 Jul 2012 phalanx

Screenshot
Pop 68.84
Vit 3.53

phalanx computes a digest of many buffers simultaneously, and produces a combined hash of them all. It is an initiative to provide a fast, simple, and portable alternative method to compute a checksum in a parallel fashion. It has options for I/O buffer size, hash width, number of threads, and more. It can be run single-threadedly for performance comparisons. It can check files against previously-saved sums, like "MD5sum" does. It also has a "demo" mode, to ascertain accurate operation. It is intended to be useful on large files and multicore/multiprocessor/multithreaded environments.

Download Website Updated 27 Jul 2011 flashrom

Screenshot
Pop 123.33
Vit 2.99

Flashrom is a utility for reading, writing, erasing, and verifying flash ROM chips. It's often used to flash BIOS/coreboot/firmware/EFI images. It supports a wide range of DIP32, PLCC32, DIP8, SO8/SOIC8, and TSOP32/40/48 chips, which use various protocols such as LPC, FWH, parallel flash, or SPI. The tool can be used to flash BIOS/firmware images, for example, be it proprietary BIOS images or coreboot (previously known as LinuxBIOS) images. It can also be used to read the current existing BIOS/firmware from a flash chip.

Download Website Updated 16 Jan 2014 ExaScale IO

Screenshot
Pop 35.38
Vit 2.85

The ExaScale IO (ESIO) library provides simple, high throughput input and output of structured data sets using parallel HDF5. It is designed to support reading and writing of turbulence simulation restart files, but it may be useful in other contexts. The library is written in C99 and may be used by C89 or C++ applications. A Fortran API built atop the F2003 standard ISO_C_BINDING is also available.

Screenshot

Project Spotlight

HighVIP

A tool for chatting and exchanging anonymous email and files securely.

Screenshot

Project Spotlight

Arkeia vmOneStep Virtual Appliance for VMware - Free Edition

A no-cost version of the Arkeia Virtual Appliance for use in VMWare environments.