The DUP System is a language for productive, parallel, and distributed stream processing on POSIX systems. Programming with DUP is similar to writing shell scripts with pipes except that filters can have multiple inputs and outputs. Furthermore, the computation can be spread across multiple computers. A distinguishing characteristic of DUP compared to other streaming languages is that filters can be written in almost any programming language. The DUP System distribution includes the runtime system and a collection of over a dozen multi-stream filters.
The Merlin project was initially started to create an easy way to set up distributed Nagios installations, allowing Nagios processes to exchange information directly as an alternative to the standard method using NSCA. It has also been extended with fault tolerance, the ability to store status information in a database, and other features. This allows Merlin to function as a backend for applications such as the Ninja project.
Consh is a set of programs that can turn one or more UNIX hosts on a trusted LAN into a singular Bourne shell multi-computer on which shell scripts are run concurrently. The service abstracts hosts into what appears to be shell process with a fixed number of threads or workers, to which work may be assigned and results received concurrently. It includes utilities that assign commands to workers in parallel and a command that initiates distributed barriers between workers for synchronization purposes. Environment variables can be set on a per-host basis to implement locking mechanisms like semaphores or ticket algorithms. Daemons can delegate work to one another as needed.
Tranche is file storage and dissemination software. Designed and built with scientists and researchers in mind, Tranche can handle very large data sets, is secure and scalable, and all data sets are citable in scientific journals. Features include a fully decentralized architecture, support for very large files, very long-term file persistence/preservation, file immutability/integrity, provenance, encryption, licensing, versioning, and citability.
TinyIDS is a distributed intrusion detection system (IDS) for Unix systems. It is based on the client/server architecture and has been developed with security in mind. The client, tinyids, collects information from the local system by running its collector backends. The collected information may include anything, from file contents to file metadata or even the output of system commands. The client passes all this data through a hashing algorithm and a unique checksum (hash) is calculated. This hash is then sent to one or more TinyIDS servers (tinyidsd), where it is compared with a hash that had previously been stored in the databases of those remote servers for this specific client. A response indicating the result of the hash comparison is finally sent back to the client. Management of the remotely stored hash is possible through the client's command line interface. Communication between the client and the server can be encrypted using RSA public key infrastructure (PKI).
Active Insight is an ESP/CEP (Event Stream Processing/Complex Event Processing) framework for real-time, value-based detection and reaction to events and patterns. It offers a distributed (cloud ready) event processing runtime with an embedded pattern engine to support event aggregation and correlation. Active Insight simplifies the development of distributed event processing using the plain old Java object (POJO) approach where events and event processors are plain Java objects wired by Spring dependency injection. The framework can be used for various applications such as homeland security, online behavioral targeting, advertising, fraud detection, SIEM, telematics, algorithmic trading, and others.
Java distributed framework is a framework for distributed grid and / or volunteer computing. It's divided into a server and client library. You can create new or implement it into existing applications in no time; you don't need knowledge about network connections, sockets, etc. The Framework does almost everything automatically. It provides secure automatic client <-> server communications, unique IDs, automatic resending of jobs to new clients if needed, user stats, and much more. The client framework supports the detection of the computer's user state (idling, away, online, etc.). It also offers many other useful features and helpers for developing a distributed client application.
Libchop is a set of utilities and library for data backup and distributed storage. Its main application is chop-backup, an encrypted backup program that supports data integrity checks, versioning at little cost, distribution among several sites, selective sharing of stored data, adaptive compression, and more. The library itself, which chop-backup builds upon, implements storage techniques such as content-based addressing, content hash keys, Merkle trees, similarity detection, and lossless compression. It makes it easy to combine them in different ways. The ‘chop-archiver’ and ‘chop-block-server’ tools, illustrated in the manual, provide direct access to these facilities from the command line. It is written in C and has Guile (Scheme) bindings.