Concerted is a highly scalable multivariate in-memory data storage library. It has built in support for multivariate queries and performs well over many styles of workloads. The data is read and stored in various data structures, and the data from data structures written to disk. It is fully ACID compliant, has APIs that abstract details from the user, and provides an easy to use interface. Many different types of indexes are provided along with various systems that provide access for data analytics.
EJDB is an embedded JSON database engine. It aims to be a fast MongoDB-like NoSQL library that can be embedded into C/C++/Nodejs/Python3/Lua applications. It features collection-level write locking, collection level transactions, string token matching queries, and a Node.js binding.
GlusterFS is a clustered filesystem capable of scaling to several petabytes. It aggregates various storage bricks over Infiniband RDMA or TCP/IP interconnect into one large parallel network file system. GlusterFS is based on a stackable user space design without compromising performance. It allows access via Swift API, SMB, NFSv3, QEMU/KVM, OpenStack Compute, OpenStack Block Storage, Xen, CloudStack, HDFS API, oVirt, and more, all in a unified backend which enables multiple, simultaneous access points to the same data stores.
KVZone is an evaluation tool for comparing performance of key-value stores. It provides various configuration parameters to match the expected application workload. It provides adapters for existing key value stores such as TokyoCabinet and simple databases such as sqlite3 and BerkeleyDB that can be used as key-value stores. New adapters can easily be written to evaluate other key-value stores.
LBackup is a simple backup system aimed at systems administrators who require reliable backups with minimum fuss. It is configured with configuration files, and the backup is started from the command line. It has been tested for over 10 years. Backups can be to local media, or to remote media via one or more networks. The networks may be private LANs, WANs, or sets of untrusted public networks such as the Internet.
Opendedup is a deduplication-based filesystem and block device designed to provide inline deduplication and flexiblity for applications. It benefits services such as backup, archiving, NAS storage, and Virtual Machine primary and secondary storage, and can be deployed in both a stand alone and distributed, multi node configuration. Standalone, it provides inline deduplication, replication, and unlimited snapshot capabilities. In a multi-node configuration, it adds global intra-volume deduplication, block storage redundancy, and block storage expandability. and will store and share unique data blocks with other volumes within the cluster. These volumes can also specify a level of redundancy for data stored in the cluster.
S3QL is a file system that stores all its data online. It supports Amazon S3, Google Storage, and OpenStack and effectively provides you with a hard disk of dynamic, infinite capacity that can be accessed from any computer with Internet access. S3QL provides a standard, full featured Unix file system that is conceptually indistinguishable from any local file system. Additional features include compression, encryption, data de-duplication, immutable trees, and snapshotting, which make it especially suitable for online backup and archiving. The design favors simplicity and elegance over performance and feature-creep. Care has been taken to make the source code as readable and serviceable as possible. Solid error detection, error handling, and extensive automated test cases are provided.
Sirix is a versioned tree-based storage system. It provides Snapshot Isolation through MVCC and is best suited for flash-based storage. The tree encoding is suited for heavy update operations. It provides diffing algorithms either to import diffs between currently shredded (imported) XML documents to update a tree structure or to get the differences between versions of a tree structure. A GUI provides several visualizations for comparing imported tree structures.