Weed-FS is a simple and highly scalable distributed file system. There are two objectives: to store billions of files, and to serve the files fast! Instead of supporting full POSIX file system semantics, it implements only a key-file mapping. Instead of managing all file metadata in a central master, it manages file volumes in the central master and lets volume servers manage files and the metadata. This relieves concurrency pressure from the central master and spreads file metadata into volume servers' memories, allowing faster file access with just one disk read operation. It is modelled on Facebook's Haystack design paper. Only 40 bytes of disk storage are required for each file's metadata, and disk reads are O(1).
filegive easily sends or receives files point-to-point, with authentication and ciphering, and the other side only needs a Web browser. No third party server is involved in the transfer. It can use common NAT traversal protocols like uPnP and NAT-PMP, manually forwarded ports, or a public ssh server.
Csum is a tool for manipulating CSV, TSV, PSV and other table formats for the command line. It can be used for converting between several formats; selecting and manipulating cells matching a selector; inserting or rearranging columns; sorting, reversing, or selecting unique rows; rotating rows so they become the columns of the table; and more. It was designed for environments where the use of a graphical spreadsheet to edit a CSV file was not possible or practical.