docs / rsync
rsync and downstream mirrors
You are welcome to copy a tree from us, whether you run a university lab, a company build farm or a public mirror of your own. These are the rules that keep three sites fast for everyone.
Modules
Every tree has an rsync module of the same name as its directory. List them with rsync n73.assetlines.net::. Modules are read-only and anonymous, and the daemon runs with max connections = 40 per module and six per client address. When the limit is reached the daemon replies with @ERROR: max connections reached; wait a minute and try again.
$ rsync n73.assetlines.net::
debian Debian archive (2.94 TB)
debian-cd Debian installer images (1.38 TB)
archlinux Arch Linux (0.13 TB)
pypi PyPI packages (27.80 TB)
...
$ rsync -aH --delete --delay-updates --timeout=600 \
n73.assetlines.net::archlinux/ /srv/mirror/archlinux/
Staying polite
- Sync no more often than the interval shown on the tree table. Pulling Debian every five minutes yields nothing new for 355 of those minutes.
- Use
--delay-updatesand, when your own users download from the copy,--delete-delay, so no one sees half a tree. - Offset your cron job by a random sleep. Everyone syncing at minute zero is how we meet our 3 a.m. alarms.
- Skip architectures and trees you do not serve with
--exclude. Debian without sources and non-amd64 ports is about 0.9 TB, a third of the full archive. - Do not run
rsync --checksum. It reads every byte on our disks and nothing on your side improves.
Becoming a public downstream mirror
If you plan to offer your copy to the public, tell us at mirror-admin@n73.assetlines.net with your hostname, link capacity and the trees you carry, and ask upstream projects to list you. We keep a short list of known downstream mirrors and will switch you to our push-trigger channel for the trees that support it, which reduces your lag from hours to minutes.
Banned clients
We block an address for 24 hours if it opens more than 60 rsync sessions in ten minutes, ignores our limits twice, or syncs with checksums on a tree over 1 TB. Blocks are logged and reviewed by hand. If you are caught by an automatic block, write to us; we will lift it and help you fix the cron job.