IS Uncapped Express limiting http downloads?

P

Paladinkz

Member
Joined
Aug 27, 2007
Messages
25
Reaction score
0
Have been using IS uncapped express+ from Axxess for the last couple of months. First month everything was fine.

Thereafter started experiencing a strange issue: almost every time I try a file >2GB from vip-file.com, downloads stop at exactly 2GB ... I use IDM and you can actually see that any connections to 2GB+ ranges get dropped.

This results in uncompleted downloads that get stuck at 2GB. I've tried investigating:
*Connected and disconnected
*Tried at various times
*Changed routers
*Tried multiple computers, changed firewall software
*Logged a fault with Axxess :eek:

No luck. Now it gets interesting.

Orbit Downloader log shows that connections go via a cache server and that resuming is not supported.
Yet at the same time a download <2GB would run fine from the same server. Torrents work fine. Newsgroups are great.

Connecting through a SAIX account solves the issue and downloads continue running (although very slow??).

Today I was experiencing the same issue. I routed IDM through an anonymous proxy does not sit on port 80. Downloads resumed and now run at full speeds!

So the issue is definitely somewhere in IS cache server it seems...

Axxess just keep quiet about it. I am wondering is it only vip-file or other servers are also affected? Is that something IS enforces?

Anybody else seen this?
 
Some software doesn't support files over 2gb. I've seen this with 32bit IIS servers, as well as some other servers. Chances are it could be the IS netcache servers...
 
Perhaps ... it is on and off though. 90% of the time I have this issue and it used to work in April...
 
i've never tried a http download of over 2GB. But from Giganews I have downloaded singlefiles larger than 20GB.

So maybe it is worth asking them if they internally set a 2GB limit on http, not thinking people could download a single file of that size or more.

EDIT: Given I have consistently downloaded files over 2GB, it is clearly not something they have done to limit downloads (given newsservers and torrents run at full speed for files larger than 2GB)
 
Last edited:
milomak said:
Given I have consistently downloaded files over 2GB, it is clearly not something they have done to limit downloads (given newsservers and torrents run at full speed for files larger than 2GB)
Click to expand...

Yup, newsgroups and torrents work fine. However newsgroups get small chunks at a time so a 20GB file is split into multiple pieces - IS would not know what size you're downloading without serious log analysis and if it is via SSL - then it is practically impossible.

Torrents establish multiple connections to various peers. Both cannot be cached by definition ...

To me it still points to their transparent cache servers - intentional or not.
 
i am willing to bet that the majority of traffic is through torrents and news servers on these accounts.

i cannot see a reason why they would intentionally limit http to 2GB when there is no limit on the other forms. Hence why I said make the call and find out if there is some limit on http. and why, if a limit exists, the number is at 2GB?
 
i am currently at 2.5GB of a 4GB DVD iso from slackware.mirror.ac.za. So it seems that your http issue is not a blanket problem

EDIT: I resumed the download and it completed without issue
 
Last edited:
milomak said:
i am currently at 2.5GB of a 4GB DVD iso from slackware.mirror.ac.za. So it seems that your http issue is not a blanket problem
Click to expand...

It's all good, but unfortunately that is a local server and requests to that do not go through IS cache.

My issue is limited to: international server, when request goes via IS transparent proxy, files >2GB
 
Paladinkz said:
IS would not know what size you're downloading without serious log analysis and if it is via SSL - then it is practically impossible.
Click to expand...
That is not entirely true, nowadays you get filtering that because it sits between you and the destination server, it can hand out its own certificate to you and do a man in the middle kind of attack, and still see what you are doing over SSL.
 
Tinuva said:
That is not entirely true, nowadays you get filtering that because it sits between you and the destination server, it can hand out its own certificate to you and do a man in the middle kind of attack, and still see what you are doing over SSL.
Click to expand...

I suppose that should only be possible if the client does not check the validity of the certificate with the issuing authority as a substitute certificate would not match with the server's address. Browsers generate a warning in this case, but I don't know if usenet clients do that.
 
Will check the link tonight and will let you know how it gets routed.
Though often IS cache refers the request to a local mirror server for open-source downloads.
 
Here's a traceroute

Code: 
# traceroute mirror.ox.ac.uk
traceroute to mirror.ox.ac.uk (163.1.2.231), 30 hops max, 60 byte packets
 1  192.168.1.1 (192.168.1.1)  0.853 ms  1.179 ms  2.141 ms
 2  dsl-241-192-01.telkomadsl.co.za (41.241.192.1)  15.303 ms  17.344 ms  19.047 ms
 3  cdsl1-rba-vl2253.ip.isnet.net (196.38.73.181)  22.620 ms  24.704 ms  26.408 ms
 4  196.38.73.86 (196.38.73.86)  28.781 ms  30.456 ms  32.787 ms
 5  cdsl1-rba-vl58.ip.isnet.net (196.38.73.81)  34.054 ms  36.216 ms  37.658 ms
 6  core2b-rba-gi1-0-10.ip.isnet.net (168.209.1.182)  41.016 ms  10.375 ms  16.902 ms
 7  mi-za-rba-p5-gi3-0-2-5.ip.isnet.net (168.209.161.134)  188.271 ms  190.082 ms  191.620 ms
 8  mi-uk-dock-p3-po2-0.ip.isnet.net (168.209.224.65)  192.415 ms  193.549 ms  195.744 ms
 9  core2a-dock-gi1-0-0-21.ip.isnet.net (168.209.163.3)  196.879 ms  199.085 ms  201.877 ms
10  core1b-dock-gi0-0-2.ip.isnet.net (168.209.246.1)  206.007 ms  207.899 ms  209.594 ms
11  gi8-13.mpd01.lon02.atlas.cogentco.com (149.6.148.1)  288.124 ms  289.681 ms  290.290 ms
12  te2-3.mpd02.lon01.atlas.cogentco.com (130.117.0.253)  391.197 ms  345.138 ms te4-2.mpd02.lon01.atlas.cogentco.com (130.117.1.17)  378.144 ms
13  195.66.226.25 (195.66.226.25)  244.624 ms  245.990 ms  247.510 ms
14  so-0-1-0.lond-sbr4.ja.net (146.97.35.129)  302.264 ms  303.801 ms  305.316 ms
15  so-6-0-0.lond-sbr1.ja.net (146.97.33.153)  344.608 ms  346.446 ms  348.151 ms
16  TVN-TVN1.site.ja.net (146.97.42.82)  246.787 ms  235.860 ms  237.625 ms
17  pos2-0.oxfo-rbr1.ja.net (193.63.108.78)  287.687 ms  287.407 ms  287.050 ms
18  oxford-university-2.ja.net (193.63.109.6)  287.001 ms  286.804 ms  279.847 ms
19  mirror1.oucs.ox.ac.uk (163.1.2.231)  236.304 ms  236.646 ms  236.891 ms
20  mirror1.oucs.ox.ac.uk (163.1.2.231)  235.028 ms  235.129 ms  233.504 ms
 
milomak said:
How abou this 4GB http url?
Click to expand...

Ok, that URL is not re-routed to a local mirror, but I am having the same problem with it :mad:

When I download directly from the URL, Internet Download Manager establishes 16 connections to the sever all from various start ranges. All connections in range 2GB+ stop.

Orbit Downloader reports: 'Can't resume'. However, when I specify an anonymous proxy server in the settings of IDM, connections to all parts of the file work fine.

Here's the log of Orbit Downloader:
Code: 
2009-07-06 21:48:26 Connecting mirror.ox.ac.uk:80
2009-07-06 21:48:26 Connected
2009-07-06 21:48:26 GET /sites/download.fedora.redhat.com/pub/fedora/linux/releases/11/Fedora/x86_64/iso/Fedora-11-x86_64-DVD.iso HTTP/1.0
2009-07-06 21:48:26 Host: mirror.ox.ac.uk
2009-07-06 21:48:26 Accept: */*
2009-07-06 21:48:26 Pragma: no-cache
2009-07-06 21:48:26 Cache-Control: no-cache
2009-07-06 21:48:26 Connection: close
2009-07-06 21:48:27 HTTP/1.0 200 OK
2009-07-06 21:48:27 Age: 0
2009-07-06 21:48:27 Date: Mon, 06 Jul 2009 19:45:23 GMT
2009-07-06 21:48:27 Content-Type: application/x-iso9660-image
2009-07-06 21:48:27 Server: Apache/2.2.3 (Debian)
2009-07-06 21:48:27 Last-Modified: Tue, 02 Jun 2009 22:21:54 GMT
2009-07-06 21:48:27 ETag: "8e7dde-fe666800-46b64f8540480"
[B]2009-07-06 21:48:27 Via: 1.1 nc1-rba (NetCache NetApp/6.0.3)
2009-07-06 21:48:27 Can't resume!
[/B]2009-07-06 21:48:27 Start receiving data
 
Last edited:
milomak said:
Here's a traceroute
Click to expand...

Actually tracing route to the server does not mean that downloads will actually run from it. Try this link: http://download.opensuse.org/distribution/11.1/iso/openSUSE-11.1-KDE4-LiveCD-i686.iso

When you try to download from there a redirect should happen automatically. Check this output from Orbit :

Code: 
2009-07-06 22:02:24 Connecting download.opensuse.org:80
2009-07-06 22:02:24 Connected
2009-07-06 22:02:24 GET /distribution/11.1/iso/openSUSE-11.1-KDE4-LiveCD-i686.iso HTTP/1.0
2009-07-06 22:02:24 Host: download.opensuse.org
2009-07-06 22:02:24 Pragma: no-cache
2009-07-06 22:02:24 Cache-Control: no-cache
2009-07-06 22:02:24 Connection: close
2009-07-06 22:02:25 HTTP/1.0 302 Found
2009-07-06 22:02:25 Date: Mon, 06 Jul 2009 19:59:21 GMT
2009-07-06 22:02:25 Content-Length: 377
2009-07-06 22:02:25 Content-Type: text/html; charset=iso-8859-1
2009-07-06 22:02:25 Server: Apache/2.2.11 (Linux/SUSE)
2009-07-06 22:02:25 X-Prefix: 196.34.0.0/15
2009-07-06 22:02:25 X-AS: 3741
2009-07-06 22:02:25 X-MirrorBrain-Mirror: ftp.up.ac.za
2009-07-06 22:02:25 X-MirrorBrain-Realm: country
2009-07-06 22:02:25 Location: http://ftp.up.ac.za/mirrors/opensuse/opensuse/distribution/11.1/iso/openSUSE-11.1-KDE4-LiveCD-i686.iso
2009-07-06 22:02:25 Via: 1.1 nc1-rba (NetCache NetApp/6.0.3)
[B]2009-07-06 22:02:25 Redirect to http://ftp.up.ac.za/mirrors/opensuse/opensuse/distribution/11.1/iso/openSUSE-11.1-KDE4-LiveCD-i686.iso
2009-07-06 22:02:25 Connecting ftp.up.ac.za:80
2009-07-06 22:02:26 Connected
[/B]2009-07-06 22:02:26 GET /mirrors/opensuse/opensuse/distribution/11.1/iso/openSUSE-11.1-KDE4-LiveCD-i686.iso HTTP/1.0


2009-07-06 22:02:26 Host: ftp.up.ac.za
2009-07-06 22:02:26 Referer: http://en.opensuse.org/Released_Version
2009-07-06 22:02:26 User-Agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30)
2009-07-06 22:02:26 Accept: */*
2009-07-06 22:02:26 Pragma: no-cache
2009-07-06 22:02:26 Cache-Control: no-cache
2009-07-06 22:02:26 Connection: close
2009-07-06 22:02:27 HTTP/1.1 200 OK
2009-07-06 22:02:27 Date: Mon, 06 Jul 2009 20:02:32 GMT
2009-07-06 22:02:27 Server: Apache/1.3.34 (Debian)
2009-07-06 22:02:27 Last-Modified: Wed, 10 Dec 2008 08:42:15 GMT
2009-07-06 22:02:27 ETag: "301317-29726800-493f80e7"
2009-07-06 22:02:27 Accept-Ranges: bytes
2009-07-06 22:02:27 Content-Length: 695363584
2009-07-06 22:02:27 Connection: close
2009-07-06 22:02:27 Content-Type: application/x-iso9660-image
2009-07-06 22:02:28 Start receiving data
2009-07-06 22:02:28 Create link ftp.up.ac.za
2009-07-06 22:02:28 Create link ftp.up.ac.za
2009-07-06 22:02:28 Create link ftp.up.ac.za
2009-07-06 22:02:28 Create link ftp.up.ac.za
2009-07-06 22:02:28 Create link ftp.up.ac.za
2009-07-06 22:02:28 Create link ftp.up.ac.za
2009-07-06 22:02:28 Create link ftp.up.ac.za
2009-07-06 22:02:32 Stop downloading by user
 
The Fedora mirror

Code: 
DEBUG output created by Wget 1.11.4 on linux-gnu.

--2009-07-07 21:34:48--  http://mirror.ox.ac.uk/sites/download.fedora.redhat.com/pub/fedora/linux/releases/11/Fedora/x86_64/iso/Fedora-11-x86_64-DVD.iso
Resolving mirror.ox.ac.uk... 163.1.2.224, 163.1.2.231
Caching mirror.ox.ac.uk => 163.1.2.224 163.1.2.231
Connecting to mirror.ox.ac.uk|163.1.2.224|:80... connected.
Created socket 4.
Releasing 0x0000000001816cd0 (new refcount 1).

---request begin---
GET /sites/download.fedora.redhat.com/pub/fedora/linux/releases/11/Fedora/x86_64/iso/Fedora-11-x86_64-DVD.iso HTTP/1.0
User-Agent: Wget/1.11.4
Accept: */*
Host: mirror.ox.ac.uk
Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.0 200 OK
Age: 0
Date: Tue, 07 Jul 2009 19:31:42 GMT
Content-Type: application/x-iso9660-image
Connection: keep-alive
Proxy-Connection: keep-alive
Server: Apache/2.2.3 (Debian)
Last-Modified: Tue, 02 Jun 2009 22:21:54 GMT
ETag: "8e7dde-fe666800-46b64f8540480"
Via: 1.1 nc1-rba (NetCache NetApp/6.0.3)

---response end---
200 OK
Length: unspecified [application/x-iso9660-image]
Saving to: `Fedora-11-x86_64-DVD.iso'

The OpenSUSE output
Code: 
cat wget.log                                                                                                         
DEBUG output created by Wget 1.11.4 on linux-gnu.                                                                              
                                                                                                                               
--2009-07-07 21:37:06--  http://download.opensuse.org/distribution/11.1/iso/openSUSE-11.1-KDE4-LiveCD-i686.iso                 
Resolving download.opensuse.org... 195.135.221.130                                                                             
Caching download.opensuse.org => 195.135.221.130                                                                               
Connecting to download.opensuse.org|195.135.221.130|:80... connected.                                                          
Created socket 4.                                                                                                              
Releasing 0x0000000000c15bc0 (new refcount 1).                                                                                 
                                                                                                                               
---request begin---                                                                                                            
GET /distribution/11.1/iso/openSUSE-11.1-KDE4-LiveCD-i686.iso HTTP/1.0                                                         
User-Agent: Wget/1.11.4                                                                                                        
Accept: */*                                                                                                                    
Host: download.opensuse.org                                                                                                    
Connection: Keep-Alive                                                                                                         
                                                                                                                               
---request end---                                                                                                              
HTTP request sent, awaiting response...                                                                                        
---response begin---                                                                                                           
HTTP/1.0 302 Found                                                                                                             
Date: Tue, 07 Jul 2009 19:33:59 GMT                                                                                            
Content-Length: 377                                                                                                            
Content-Type: text/html; charset=iso-8859-1                                                                                    
Connection: keep-alive                                                                                                         
Proxy-Connection: keep-alive                                                                                                   
Server: Apache/2.2.11 (Linux/SUSE)
X-Prefix: 196.34.0.0/15
X-AS: 3741
X-MirrorBrain-Mirror: ftp.up.ac.za
X-MirrorBrain-Realm: country
Location: http://ftp.up.ac.za/mirrors/opensuse/opensuse/distribution/11.1/iso/openSUSE-11.1-KDE4-LiveCD-i686.iso
Via: 1.1 nc1-rba (NetCache NetApp/6.0.3)

---response end---
302 Found
Registered socket 4 for persistent reuse.
Location: http://ftp.up.ac.za/mirrors/opensuse/opensuse/distribution/11.1/iso/openSUSE-11.1-KDE4-LiveCD-i686.iso [following]
Skipping 377 bytes of body: [<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>302 Found</title>
</head><body>
<h1>Found</h1>
<p>The document has moved <a href="http://ftp.up.ac.za/mirrors/opensuse/opensuse/distribution/11.1/iso/openSUSE-11.1-KDE4-LiveCD-i686.iso">here</a>.</p>
<hr>
<address>Apache/2.2.11 (Linux/SUSE) Server at download.opensuse.org Port 80</address>
</body></html>
] done.
--2009-07-07 21:37:07--  http://ftp.up.ac.za/mirrors/opensuse/opensuse/distribution/11.1/iso/openSUSE-11.1-KDE4-LiveCD-i686.iso
conaddr is: 195.135.221.130
Resolving ftp.up.ac.za... 137.215.98.34
Caching ftp.up.ac.za => 137.215.98.34
Releasing 0x0000000000c180c0 (new refcount 1).
Found ftp.up.ac.za in host_name_addresses_map (0xc180c0)
Connecting to ftp.up.ac.za|137.215.98.34|:80... connected.
Created socket 5.
Releasing 0x0000000000c180c0 (new refcount 1).

---request begin---
GET /mirrors/opensuse/opensuse/distribution/11.1/iso/openSUSE-11.1-KDE4-LiveCD-i686.iso HTTP/1.0
User-Agent: Wget/1.11.4
Accept: */*
Host: ftp.up.ac.za
Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.1 200 OK
Date: Tue, 07 Jul 2009 19:37:08 GMT
Server: Apache/1.3.34 (Debian)
Last-Modified: Wed, 10 Dec 2008 08:42:15 GMT
ETag: "301317-29726800-493f80e7"
Accept-Ranges: bytes
Content-Length: 695363584
Keep-Alive: timeout=15, max=100
Connection: Keep-Alive
Content-Type: application/x-iso9660-image

---response end---
200 OK
Disabling further reuse of socket 4.
Closed fd 4
Registered socket 5 for persistent reuse.
Length: 695363584 (663M) [application/x-iso9660-image]
Saving to: `openSUSE-11.1-KDE4-LiveCD-i686.iso'
 
You must log in or register to reply here.
Back
Top
Sign up to the MyBroadband newsletter
X