Main menu:

Sponsoring

Please consider a small donation:

 

 

Or you can donate bitcoin:

 

Thanks to TekLinks in Birmingham, AL, for providing colocation and bandwidth.

Page Rank

Fame

FOSS Force Best Blog--2013 Award

Recent posts

Recent comments

About this blog

I am Eric Hameleers, and this is where I think out loud.
More about me.

Search

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 222 other subscribers

My Favourites

Slackware

Calendar

August 2016
M T W T F S S
« Jul    
1234567
891011121314
15161718192021
22232425262728
293031  

RSS Alien's Slackware packages

RSS Alien's unofficial KDE Slackware packages

RSS Alien's multilib packages

RSS Slackware64-current

Meta

taper.alienbase.nl mirror will lose rsync access

For the sixth time in just 5 days I had do a system_reset on my virtual machine which runs “taper.alienbase.nl” as well as “docs.slackware.com“. The virtual machine is crashing under the load that is put on it by demanding rsync processes. According to my pal who donated the use of this VM to me for free, the rsync download rate is at a continuous 100 Mbit/sec for most of the time. This is apparently too much for the server, as well as for my pal who had not anticipated this kind of bandwidth consumption. He has been paying quite a bit of extra money for the excess bandwidth during the past months.

I do not like it when someone loses money because of me, so drastic measures are required.

As of tomorrow (monday 15 Feb 2016) I will kill the rsync access to taper.alienbase.nl.

HTTP access will still be allowed, so people who configured slackpkg to download from my server will still be served.

I hope that this will put my pal at ease again, and also prevent the server from crashing.

Apologies for the inconvenience this causes to people who use rsync to keep their local mirrors up to date. I will try to find another location to host my SlackBuild repository as well as the multilib and KDE (ktown) repositories. The downtime of this VM caused downtime for docs.slackware.com as well which I think is unacceptible.

Eric

Comments

Comment from John Yost
Posted: February 15, 2016 at 00:04

Greetings Eric
Guilty as charged.
My apologies and I will in the future try to be a better site user.
Thanks For All Your Efforts For Slackware
John

Comment from Mike Langdon
Posted: February 15, 2016 at 13:17

Hi Eric,

I have switched to your uk mirror for awhile. However, the checksums failed for the slackbuilds repo.

Thanks for providing these builds – it would take me forever to build some of these. It is time for me to upgrade this ancient box.

Comment from Mike Langdon
Posted: February 15, 2016 at 13:42

Sorry – the failed part read:
fails to download CHECKSUMS.md5

Comment from Niki Kovacs
Posted: February 15, 2016 at 14:40

Why not consider a Dedibox SC offer from online.net? 5,99 euros / month with unlimited bandwidth, it’s not a VPS but a *real* server, and Slackware runs great on it. I have three of these boxes (one bigger “classic” for production for 30 euros / month, two “SC” for backups and testing). Quality of service is great.

Comment from alienbob
Posted: February 15, 2016 at 23:20

Niki, that is indeed a nice price for something that does not need a lot of CPU power but lots of bandwidth.
Still, another bill to pay.

Comment from Karl
Posted: February 16, 2016 at 02:14

I’ve got a couple of machines with similar bandwidth available (100Mbps each) which I can use to provide rsync mirrors. We don’t pay for traffic, so it won’t cost us anything extra. If you’re interested, I could have them set up by the end of the week. Let me know via email (let me know where I should pull from)

Comment from alienbob
Posted: February 16, 2016 at 12:40

Hi Karl

Your mirrors is certainly welcome. If you have a mirror URL and decent bandwidth and a good uptime, I can add your URL to the list of mirrors that I mention every time when I do a repository update.
I still allow rsync access for “slackware.uk” and that site is able to keep an uptodate mirror of my “taper.alienbase.nl” server. Any content you need to mirror can be obtained from that site. Yesterday, a mirror of the slackware-live ISOs was added to slackware.uk, and that is still syncingf. Hopefully the sync will be complete today. Then a mirror of all my stuff will be available on slackware.uk.

Grateful for every reliable and fast mirror that people setup! Thanks.

Comment from schu
Posted: February 16, 2016 at 21:18

Eric, I can spool up a vm to mirror stuff in Seattle. Send me an email with an rsync url to source from, the frequency you would like updates, and I’ll get it built in the next day or two and return the hostname.

Comment from alienbob
Posted: February 16, 2016 at 21:41

At the moment the most accessible and also fast location would be slackware.uk. Darren who maintains that server has whitelist access to taper.alienbase.nl so he’ll never be far behind my updates.

The most important ones are:
multilib: rsync://slackware.uk/people/alien/multilib/
slackbuilds: rsync://slackware.uk/people/alien/slackbuilds
sbrepos: rsync://slackware.uk/people/alien/sbrepos
ktown: rsync://slackware.uk/people/alien-kde/

Note that by rsync-ing slackware.uk/people/alien with the “H” option will save you gigabytes of space because lots of files in there are hard-linked: “rsync -HrlptD rsync://slackware.uk/people/alien /your/local/storage/”

And slackware-live should soon appear as: rsync://slackware.uk/people/alien-slacklive

And take note of this message on the slackware.uk homepage:

Notice to mirrors:
If you are running a mirroring service and pulling data from us on a regular basis, please email for access to our un-capped, non-bandwidth limited service – your updates will then be unaffected by bandwidth limitations and user-level capping.

Comment from Darren
Posted: February 16, 2016 at 23:21

Just a note about the ‘Notice to mirrors’ on the site – at the moment I don’t implement any bandwidth capping as the usage has never required it. Rsync itself is limited to 150 connections in total; so unless it’s release day (where I get hammered!) there should be no problems with access.
I should really edit that MOTD 😀

If you do find any problems, or need help setting up your rsync script to pull data from the site, feel free to drop me an email (address on the homepage).

Cheers,
Darren.

Comment from Tonus
Posted: February 19, 2016 at 22:15

Hi Darren,

Could you tell me the space each repo has on your server ?

It is asked by a potential mirror maintainer.

Anyway, thanks for your mirror !

Comment from chrisretusn
Posted: February 17, 2016 at 15:03

I used your taper sight for manually syncing ktown and multilib and only when needed. Just two simple bash scripts with the appropriate rsync options including excludes for the unneeded parts. I was considering adding the live-ISO’s to the mix. I currently do a manual via the browser download.

Must of been a lot of folks syncing taper to cause those problems. Really appreciate having the alternate locations. Many thanks to Darren for this and to those other fine folks offering up server space. Wish I could do the same.

Comment from schu
Posted: February 17, 2016 at 20:25

Eric, can you remove my last message, I don’t need you to email me anymore. I have the mirror going now:

http://mirrors.aptalaska.net/slackware/
rsync://mirrors.aptalaska.net/slackware/

Comment from Darren
Posted: February 19, 2016 at 23:23

Hey,
Here’s a ‘du’ of all the repos:
9.7G absolute
132M csb
14G gsb
9.7G microlinux
1.2G msb
15G people/alien
5.4G people/alien-arm
12G people/alien-kde
7.9G people/alien-slacklive
3.6G people/alphageek
29G people/rworkman
22G porteus
107G salix
63G sbosrcarch
779M slackbuilds.org
27G slackintosh
158G slackware
23G slackwarearm
49G slacky
18G slamd64
21G slaxbmc
8.0K slint
109M sls
23G splack
14G truva

Hope that helps 🙂

Comment from Karl
Posted: February 20, 2016 at 04:41

Thanks Eric and Darren.

I’ve got the mirrors running now. The URLs are
rsync://slackware1.gsacrd.ab.ca/mirrors
rsync://slackware2.gsacrd.ab.ca/mirrors

Comment from Drakeo
Posted: February 20, 2016 at 13:45

are you sure them dates are correct on this mirror.
http://mirrors.aptalaska.net/slackware/people/alien/multilib/current/slackware64-compat32/x-compat32/
if so I would wonder.

Comment from alienbob
Posted: February 21, 2016 at 13:37

Drakeo, perhaps something changed on that mirror since you posted your message, but the dates look OK to me.

Comment from Darren
Posted: February 21, 2016 at 17:00

I don’t think it was me that mentioned the date thing.
But…

On occasion people may notice ‘old’ files due to the time it takes to sync from Eric’s server (at most i’ve only ever got ~300K/sec), and that I use –delay-updates with rsync since this makes all syncs ‘atomic’

Well, as atomic as atomic gets with rsync. ‘New’ files are not moved into place until every file is downloaded – this prevents the repos havng some ‘new’ files and ‘old’ ones at the same time. I’d recommend –delay-updates (along with –partial-dir) to anyone running a mirror.

I can post the full set of options I use if people are interested 🙂

Comment from schu
Posted: February 23, 2016 at 01:17

@Drakeo, yea, dates are correct, I’m -9 GST so it looks like a different day, but it’s not.

As for mirroring, I’m using:
rsync -ravlH –delete –no-motd –delay-updates –partial-dir –safe-links

Write a comment