86 projects tagged "Mirroring"
Flac-utils is a toolkit for managing FLAC files. Its primary usage is syncing metadata between sets of FLAC files. Flac-utils also provides a Python module called flac_compare that can be used separately. The utilitiy consist of three tools: flac-sync, which syncs a file tree of FLAC comments for files with the same audio-part; flac-diff, which compares two FLAC files' metadata information and shows the differences; and flac-add-picture, which adds album cover art to the files using Amazon.
mod_asn is an Apache module that uses BGP routing data to look up the autonomous system (AS) and the network prefix (subnet) which contains a given (client's) IP address. mod_asn is highly scalable. To do lookups in high-speed, it uses the PostgreSQL ip4r datatype, which is indexable with a Patricia Trie algorithm to store network prefixes. This is the most suitable algorithm, being able to search through around 250,000 existing prefixes quickly. mod_asn is usable as a standalone module, and the lookup result can be used by scripts or other Apache modules. For instance, a download redirector could base its decisions on the lookup result provided by mod_asn.
MirrorBrain is a framework to run a content delivery network using mirror servers. It solves a challenge that many popular open source projects face: a flood of download requests, often magnitudes more than a single site could practically handle. A central (and probably the most obvious) part is a "download redirector" that automatically redirects requests from Web browsers or download programs to a mirror server near them. Choosing a suitable mirror for a user's request is the key, and MirrorBrain uses geolocation and global routing data to make a sensible choice and achieve load-balancing for the mirrors at the same time. The algorithm is both sophisticated and easy to control and tune. In addition, MirrorBrain monitors mirrors, scans them for files, generates mirror lists, and more.
apub is a tool to simplify uploading documents of a site to remote servers. Simply create an XML configuration file containing one or more site definitions, with the local and remote document root. After that, you can upload any file in any of your document roots with one simple command.
TRIXER creates catalogs of transparent file indexes. A transparent file index is an exact mirror of a directory, except that each of its file is void, thus "taking no space", while apparently having the same size of its indexed counterpart so as to describe it fully. This is accomplished by combining sparse files support with fusecompress on-the-fly compression technology. This is useful for many purposes, e.g. creating a catalog of your CD/DVD-ROM library to browse its contents without having to physically access it. The advantage of this software is that a TRIXER catalog is a plain mountable ext2 filesystem, allowing enhanced interoperability with the huge lot of available software to handle the catalog in a number of ways.
vm-image-manage is a simple script for managing a small cluster of Xen virtual machines on a single host with one command. It's optimized for repeatedly restarting a virtual machine slot with an image. It features templates for Xen configuration files. It speeds the import and export of Xen images to tgz archives. It speeds frequent redeployment with rsync. It manages mounting domains when the VM is down and un-mounting when the domain is launched.
wget can be used to download a Web site, with all pages referenced by the originating one, but it saves all pages in a directory tree (or single directory). The intention of web-archive-creator is to join the power of wget and the usability of the .war format, which Konqueror is able to browse. The Web ARrchive format is simply a tarred and gzipped file containing the Web files. The web-archive-creator script performs the download with wget and writes an index.html linking to the starting pages/URLs wget fetched.