RSS 14 projects tagged "parallel"

Download Website Updated 22 Mar 2014 GNU Parallel

Screenshot
Pop 896.47
Vit 65.36

GNU parallel is a shell tool for executing jobs in parallel locally or using remote computers. A job is typically a single command or a small script that has to be run for each of the lines in the input. The typical input is a list of files, a list of hosts, a list of users, a list of URLs, or a list of tables. If you use xargs today you will find GNU parallel very easy to use, as GNU parallel is written to have the same options as xargs. If you write loops in shell, you will find GNU parallel may be able to replace most of the loops and make them run faster by running several jobs in parallel. GNU parallel makes sure output from the commands is the same output as you would get had you run the commands sequentially. This makes it possible to use output from GNU parallel as input for other programs.

Download No website Updated 26 Aug 2011 mulk

Screenshot
Pop 73.48
Vit 2.39

mulk is a multi-connection command line tool to download Internet sites. It is similar to wget and cURL, but manages up to 50 parallel links. The main features are: recursive fetching, Metalink retrieval, segmented downloading, and image filtering by width and height.

No download Website Updated 23 May 2009 Consh

Screenshot
Pop 17.46
Vit 42.32

Consh is a set of programs that can turn one or more UNIX hosts on a trusted LAN into a singular Bourne shell multi-computer on which shell scripts are run concurrently. The service abstracts hosts into what appears to be shell process with a fixed number of threads or workers, to which work may be assigned and results received concurrently. It includes utilities that assign commands to workers in parallel and a command that initiates distributed barriers between workers for synchronization purposes. Environment variables can be set on a per-host basis to implement locking mechanisms like semaphores or ticket algorithms. Daemons can delegate work to one another as needed.

No download Website Updated 07 Oct 2009 BurnerOnFire

Screenshot
Pop 17.89
Vit 1.00

BurnerOnFire is a multi-threaded program that can write the same content to multiple CD/DVD burners simultaneously. It is currently developed and tested only on Debian and only supports content in the form of ISO files. It uses D-Bus/HAL specification to interact with hardware. It spawns subprocesses that wrap around the command line program Wodim. BurnerOnFire has both CLI and GUI (GTK+) interfaces.

Download No website Updated 14 Jun 2010 Crossplex

Screenshot
Pop 42.25
Vit 2.55

The Crossplex package of make macros simplifies the creation of embedded systems, and is powerful enough for large organizations to use for developing elaborate product lines. It allows you to organize many different products under a logical structure, making systems of any complexity easy to specify. When you have many different target platforms, each with multiple different software configurations, Crossplex keeps those configurations from stepping on each other, without requiring redundancy in your source tree. Crossplex allows you to use a single dependency tree encompassing both in-house software and third-party packages, and it is particularly suited to build automation. Crossplex makes it easy to shield your build from the host environment, setting all shell variables explicitly, and giving you complete control over the path that is used at any point in the build. This is nice when you want to support building on a variety of development platforms. Crossplex scales to your needs. You can dabble in the unpacking and patching features as you need them, or you can base your entire system from the ground up on the Crossplex framework. Crossplex supports creation and use of glibc and uClibc toolchains.

No download No website Updated 08 Mar 2010 PupyMPI

Screenshot
Pop 17.61
Vit 38.75

PupyMPI is a generic 100% Python MPI implementation. It aims to cover most of the MPI 1.3 API specifications, but pays less attention to performance.

No download Website Updated 19 May 2010 Multicrush

Screenshot
Pop 28.57
Vit 1.00

Multicrush is a wrapper around pngcrush that distributes the work of brute-force compressing a single image over several pngcrush processes. This gets you a slightly less than a linear speedup, caused by different compression methods having slightly different durations. For example, the author has measured a speedup of 1.92 on a 2-core Intel T5300, and 3.86 on a 4-core Intel Q6600. The only requirements are a copy of pngcrush and at least Python 2.4. If you have version 2.6 or higher, multicrush can automatically detect how many CPUs to use.

Download Website Updated 30 Jun 2010 PyMW

Screenshot
Pop 46.99
Vit 1.00

PyMW is a Python module for parallel master-worker computing in a variety of environments. With the PyMW module, users can write a single program that scales from multicore machines to global computing platforms.

No download No website Updated 16 Dec 2010 OpenMPF

Screenshot
Pop 17.06
Vit 34.92

OpenMPF is a library for solving large, dense, multi-RHS linear systems. It is based on MPI/openMP parallelism, and relies on BLAS/LAPACK/MUMPS for the single node computations. It implements direct and iterative solvers, out-of-core matrices and vectors, and is easily accessible through a Python interface.

No download No website Updated 05 Jan 2011 Elemental

Screenshot
Pop 23.45
Vit 34.63

Elemental is a C++ framework for distributed-memory dense linear algebra that strives to be fast, portable, and programmable. It can be thought of as a generalization of PLAPACK to element-by-element distributions that also makes use of recent algorithmic advances from the FLAME project. Elemental usually outperforms both PLAPACK and ScaLAPACK, however, it heavily relies on MPI collectives so a good MPI implementation is crucial. Both pure MPI and hybrid OpenMP-MPI configurations are supported.

Screenshot

Project Spotlight

ChaiScript

An embedded scripting language for C++.

Screenshot

Project Spotlight

MUltihost SSH Wrapper

Broadcasts commands over SSH to multiple hosts.