59 projects tagged "Mirroring"
HTTrack is an easy-to-use offline browser utility. It allows you to download a Web site from the Internet to a local directory, building recursively all directories, getting HTML, images, and other files from the server to your computer. HTTrack arranges the original site's relative link-structure. Simply open a page of the mirrored Web site in your browser, and you can browse the site from link to link, as if you were viewing it online. HTTrack can also update an existing mirrored site, and resume interrupted downloads. WebHTTrack is a Web-based GUI for HTTrack.
lftp is a sophisticated command line based file transfer program. Supported protocols include FTP, HTTP, SFTP, and FISH. It has a multithreaded design allowing you to issue and execute multiple commands simultaneously or in the background. It also features mirroring capabilities and will reconnect and continue transfers in the event of a disconnection. Also, if you quit the program while transfers are still in progress, it will switch to nohup mode and finish the transfers in the background. Additional protocols supported: FTP over HTTP proxy, HTTPS and FTP over SSL, BitTorrent protocol. IPv6 is fully supported. There are lots of tunable parameters, including rate limitation, number of connections limitation and more.
rsync is a replacement for rcp (and scp) that has many more features. It uses the "rsync algorithm" which provides a very fast method for remote files into sync. It does this by sending just the differences in the files across the link, without requiring that both sets of files are present at one of the ends of the link beforehand.
UDPCast allows to send data simultaneously to many destinations on a local net. This can for instance be used to install entire classrooms of PCs at once. The advantage over using other methods (nfs, ftp, whatever) is that udpcast uses Ethernet's multicast abilities: it won't take longer to install 15 machines than it would to install 2. The tool comes with a busybox bootdisk for easy loading of the tool. However, udpcast can also be started from the command line of an already installed system, and can be used for other purposes than just system installation.
rsynchelper helps you use the mirroring program rsync. rsynchelper makes it easier for groups of servers to cooperate in mirroring. rsynchelper makes it easier to make your content available for others to mirror, makes it easier to mirror someone else's content, and it automates the maintenance of an accurate list of who is maintaining which content.
rdiff-backup backs up one directory to another. The target directory ends up a copy of the source directory, but extra reverse diffs are stored in a special directory so you can still recover files lost some time ago. The idea is to combine the best features of a mirror and an incremental backup. rdiff-backup can also operate in a bandwidth- efficient manner over a pipe, like rsync. Thus you can use rdiff-backup and ssh to securely back up to a remote location, and only the differences will be transmitted. It can also handle symlinks, device files, permissions, ownership, etc., so it can be used on the entire file system.
A program that parses METAR, TAF, SYNOP, and BUOY messages and stores them as XML.