FTP: 4GB file size limit

F

FacELesS.

Well-Known Member
Joined
May 9, 2005
Messages
185
Reaction score
0
I have a ftp server on my debian box (vsftpd) which sometimes servers files over 4GB (up to 7GB per file sometimes).

The problem is that when accessing this ftp from windows XP, explorer recognises the file at 4GB when it is actually larger. It also copies only 4GB. I have not yet tried different windows ftp clients (apart from explorer), but tried 2 different windows XP machines (ntfs drives).

I then tried it from another debian box from the command line (ftp command). It atleast recognised the file at being over 4GB, but failed to download much more than 4GB.

I scanned through the vsftpd.conf man but didn't find any option relating to this.
Is it an inherent limitation of ftp, if not what causes this?
How does one solve this?
 
First off, my experience of FTP servers is mostly with proftpd, (which definitely supports file larger than 4GB).

The vsftpd FAQ simply says that it supports large files >2GB

Anyway, I switched from proftpd to vsftpd on my home desktop to try and replicate your problem. I ftp'd locally on the same box and I could download a 6GB file without any problems.

Code: 
Tue Nov 18 22:01:56 2008 288 127.0.0.1 6548291584 /pub/data.iso b _ o a -anonymous@ ftp 0 * c

From your post I would guess you're using ext3, so no problems with max file size on that fs, or ntfs.
I would suggest testing with another client, like a gftp or even with firefox.

P.S. I tested on Slamd64 12.1 with vsftpd 2.0.7 and 2.6.26.6 kernel and reiser3 fs.
 
Thanks for the attempt. I'll try out different clients tomorrow.
The linux filesystems in use were jfs and ext3, so as you said no issue with large files.
 
Contrary to my plans I didn't have much time for tests today, but firefox seems unaffected by this problem.
 
Since you are using NTFS on your client side drives, it's not the problem there either, since NTFS supports those sizes and above.

I think it's got something to do with your ftp server for some reason. I don't have nay experience with Linux based FTP servers, but I hope you find the problem.
 
I have tried googling this problem and came up with nothing.

The most common reason a max file size is set (like mentioned) is because of the file system being used, with fat32 having a 4.3Gb max file size limit.

Other than this there SHOULD be no problem. All I can suggest is to try a different server, maybe proftpd (http://www.proftpd.org/) or even the lightweight oftpd (http://www.time-travellers.org/oftpd).

Samba had a problem like this, but has been sorted with CIFS it seems. Only related problem I could find.
 
MS Internet Explorer has a 4GB download limit. Try a different FTP client.
 
neobyte said:
MS Internet Explorer has a 4GB download limit. Try a different FTP client.
Click to expand...

I think I heard of this years ago, but totally forgot about it. Ah, the little bits of info one forgets can sometimes be important lol.

Thanks for sharing.
 
Yeah, we learned this pretty quickly working for an engineering firm. We had 2tB files thrown around...
 
I'll play around with other ftp servers over the weekend. Filezilla recognises the file size correctly and downloads the big file without any problem though.

You say MS Internet Explorer has a 4GB download limit, so I assume normal windows explorer uses the same backend to view/download things over ftp, because normal windows explorer gives problems (haven't tried IE).
 
You must log in or register to reply here.
Back
Top
Sign up to the MyBroadband newsletter
X