Hi grim.
It's most definitely not the website, but rather webafrica that is problematic on that site.
If you use the none ssl link:
http://my.elitehost.co.za/speedtest/ you'll notice that speeds are fine. This indicates that something is blocking speed to SSL to that site, which I manage.
Also if you use the ssl version on IS or any other ISP, the speeds are fine.
It's not some obscure slow server I'm testing from. That's a server hosted on the IS network which only hosts that website. No problems on the server itself, only from webafrica between the hours of 9:50am and 5:00pm.
EDIT: This does cause some concern for all our clients who order hosting services from us who may be on the webafrica network as they'll have a very shoddy experience as our whole billing system is on SSL.