107 projects tagged "Mirroring"

Download Website Updated 30 Jan 2001 wget_worker

Screenshot
Pop 18.81
Vit 1.79

wget_worker is a Perl script that uses wget to download from the Web in parallel. It supports URL filtering to download only URLs that match your pattern specified by Perl's regular expression.

Download No website Updated 16 Dec 1999 Spegla

Screenshot
Pop 21.02
Vit 72.64

Spegla is a mirror program for FTP sites that makes a complete mirror of an FTP area.

Download Website Updated 22 Apr 2013 HTTrack/WebHTTrack

Screenshot
Pop 657.04
Vit 25.96

HTTrack is an easy-to-use offline browser utility. It allows you to download a Web site from the Internet to a local directory, building recursively all directories, getting HTML, images, and other files from the server to your computer. HTTrack arranges the original site's relative link-structure. Simply open a page of the mirrored Web site in your browser, and you can browse the site from link to link, as if you were viewing it online. HTTrack can also update an existing mirrored site, and resume interrupted downloads. WebHTTrack is a Web-based GUI for HTTrack.

Download Website Updated 30 Jan 2001 JCheckLinks

Screenshot
Pop 31.16
Vit 2.01

JCheckLinks a Java app that does hyperlink validation. It is multi-threaded, has an include/exclude list to determine which URLs will be harvested for more links and which will be only checked with a HEAD request, and adheres to the Robots Exclusion Protocol (/robots.txt).

Download Website Updated 07 May 2014 lftp

Screenshot
Pop 902.54
Vit 178.42

lftp is a sophisticated command line based file transfer program. Supported protocols include FTP, HTTP, SFTP, and FISH. It has a multithreaded design allowing you to issue and execute multiple commands simultaneously or in the background. It also features mirroring capabilities and will reconnect and continue transfers in the event of a disconnection. Also, if you quit the program while transfers are still in progress, it will switch to nohup mode and finish the transfers in the background. Additional protocols supported: FTP over HTTP proxy, HTTPS and FTP over SSL, BitTorrent protocol. IPv6 is fully supported. There are lots of tunable parameters, including rate limitation, number of connections limitation and more.

Download Website Updated 18 Mar 1998 w3mir

Screenshot
Pop 43.75
Vit 2.70

w3mir is an "all purpose" HTTP copying and mirroring program. The long development time has resulted in a very feature-rich first version. w3mir consists of a Perl script that runs on Unix and Win32 platforms. It supports HTML4.0 and has partial support for CSS2.

Download Website Updated 12 Jan 2014 rsync

Screenshot
Pop 763.63
Vit 33.70

rsync is a replacement for rcp (and scp) that has many more features. It uses the "rsync algorithm" which provides a very fast method for remote files into sync. It does this by sending just the differences in the files across the link, without requiring that both sets of files are present at one of the ends of the link beforehand.

Screenshot

Project Spotlight

libcap-ng

An alternate POSIX capabilities library.

Screenshot

Project Spotlight

giflib

A library that decodes and encodes GIF image files.