21 projects tagged "storage"
Opendedup is a project that develops a deduplication based filesystem for Windows and Linux called SDFS. SDFS is designed to support the unique needs of virtual environments and supports enhanced functionality for VMWare, Xen, and KVM. It can deduplicate a petabyte or more of data. It supports over 3TB per gigabyte of memory at a 128k chunk size. It can perform deduplication/reduplication at a line speed of 250 MB/s or more. VMware support: it works with vms, and can deduplicate at 4k block sizes. This is required to deduplicate Virtual Machines effectively Deduplicated data can be stored locally, on the network across multiple nodes, or in the cloud. The filesystem can deduplicate inline or periodically based on needs. This can be changed on the fly. There is support for file or folder level snapshots.
GlusterFS is a clustered filesystem capable of scaling to several petabytes. It aggregates various storage bricks over Infiniband RDMA or TCP/IP interconnect into one large parallel network file system. GlusterFS is based on a stackable user space design without compromising performance.
EJDB is an embedded JSON database engine. It aims to be a fast MongoDB-like NoSQL library that can be embedded into C/C++/Nodejs/Python3/Lua applications. It features collection-level write locking, collection level transactions, string token matching queries, and a Node.js binding.
TomP2P is a P2P-based high performance key-value pair storage library. Each peer has a table (either disk-based or memory-based) to store its values. A single value can be queried or updated with a secondary key. The underlying communication framework uses Java NIO to handle many concurrent connections.
LBackup is a simple backup system aimed at systems administrators who require reliable backups with minimum fuss. It is configured with configuration files, and the backup is started from the command line. It has been tested for over 10 years. Backups can be to local media, or to remote media via one or more networks. The networks may be private LANs, WANs, or sets of untrusted public networks such as the Internet.
TSM monitor is a Web application written in PHP to help TSM administrators quickly get reports and health status information from their TSM servers. It generates its content dynamically so one can easily add or modify queries to adapt the application to one’s own needs. It features customizable queries, a dynamically generated navigation menu, an overview page with traffic light logic, graphical timetable charts for queries with start and end time (like backups and schedules), multiple servers, login protection (authentication against a default TSM server), and result caching for better performance.
UnQLite is a in-process software library which implements a self-contained, serverless, zero-configuration, transactional NoSQL database engine.It is a document store database similar to MongoDB, Redis, CouchDB, etc. as well a standard key/value store similar to BerkeleyDB, LevelDB, etc. It reads and writes directly to ordinary disk files. A complete database with multiple collections is contained in a single disk file. The database file format is cross-platform, and you can freely copy a database between 32-bit and 64-bit systems or between big-endian and little-endian architectures.
Zfswatcher is ZFS storage pool monitoring and notification daemon. It periodically inspects the zpool status and sends configurable notifications on status changes such as disk failures. It also controls the disk enclosure LEDs. There is an embedded Web interface for displaying status and logs.
A simple social network with some project management features.