Projects / MirrorBrain

MirrorBrain

MirrorBrain is a framework to run a content delivery network using mirror servers. It solves a challenge that many popular open source projects face: a flood of download requests, often magnitudes more than a single site could practically handle. A central (and probably the most obvious) part is a "download redirector" that automatically redirects requests from Web browsers or download programs to a mirror server near them. Choosing a suitable mirror for a user's request is the key, and MirrorBrain uses geolocation and global routing data to make a sensible choice and achieve load-balancing for the mirrors at the same time. The algorithm is both sophisticated and easy to control and tune. In addition, MirrorBrain monitors mirrors, scans them for files, generates mirror lists, and more.

Tags
Licenses
Operating Systems
Implementation

Recent releases

  •  04 Feb 2014 20:24

    Release Notes: An annoying bug was fixed that 2.17.0 introduced which hit new installs (an error message about a missing database column). Numerous other small bugs were fixed. And most pleasingly, the HTML output of the .mirrorlist pages has been modernized (therefore, you might want adjust your CSS styling).

    •  22 Feb 2012 01:07

      Release Notes: The most significant bugfix in this release is for a crash which could (only) occur when fallback mirrors were configured (hardcoded with the MirrorBrainFallback directive in the Apache configuration file). The other fixes are mostly to adjust for newer Python and build environments. The scanner is a little better. URL signing (introduced in 2.14.0) is now considered stable.

      •  14 Nov 2010 18:56

        Release Notes: New features: support for generating Yum-style mirror lists. Support for scanning Nginx directory listings. Bugfixes and improvements in the mirror scanner. Extensive directions on tuning PostgreSQL for MirrorBrain.

        •  06 Nov 2010 15:41

          Release Notes: MirrorBrain can now use geographical distance as additional criterion in mirror selection. Per-file mirror lists visualize the closest mirrors via Google Maps. Running behind a load balancer or other reverse proxy was tested and a bug was fixed in this regard. MirrorBrain can now be used in conjunction with a multitude of access control mechanisms available in Apache. Experimental support for restricted downloads has been implemented, by redirecting to temporary URLs whose validity can be verified by the mirrors.

          •  20 Oct 2010 14:50

            Release Notes: This release improves the usability of the mirror scanner by adding a terse report format (which makes it easy to spot problems), and a totally quiet mode where only errors will be output. It improves usability in some other corners, and adds documentation, notably the added instructions on setting up automatic GeoIP database updates.

            Screenshot

            Project Spotlight

            OpenStack4j

            A Fluent OpenStack client API for Java.

            Screenshot

            Project Spotlight

            TurnKey TWiki Appliance

            A TWiki appliance that is easy to use and lightweight.