Php photo gallery TWG | JFUploader | TWG Flash upload | WFU | Forum
https://www.tinywebgallery.com/forum/

System Settings for Very Large File uploads
https://www.tinywebgallery.com/forum/viewtopic.php?f=13&t=3002
Page 1 of 1

Author:  kgnewikow [ 25. May 2011, 15:52 ]
Post subject:  System Settings for Very Large File uploads

We are using JFUploader at a printing company on a (Mac OS X Snow Leopard Server) that sometimes has very large client files to upload (20 GB Maximum).

Current settings are:
PHP upload limit (in KB): 51200000
PHP memory limit (in KB): 131072
PHP max input time: 19200 s
PHP max execution time: 18600 s
Default socket timeout: 19200 s

I am currently testing a 2GB upload that suggests I should increase PHP max execution time and Default socket timeout to at least 72000 s to be able to support a 20 GB upload.

What system settings

PHP memory limit (in KB):
PHP max input time:
PHP max execution time:
Default socket timeout:

are recommended for very large file uploads (2 GB -20 GB (max))?

Thank you,

Author:  TinyWebGallery [ 25. May 2011, 16:06 ]
Post subject:  Re: System Settings for Very Large File uploads

Hi,

I can only test up to 2 GB because normal an Apache 32 Bit has a limit of 2 GB. e.g. 3 GB are interpreted as -1 GB.
Do you have a 64 bit php?

And you know that 72000 s = 50 days.

For this big uploads I recommend to use FTP because HTTP does not have resume.

- Michael

Author:  TinyWebGallery [ 25. May 2011, 16:11 ]
Post subject:  Re: System Settings for Very Large File uploads

I just found this for an ASP upload.

http://www.motobit.com/help/ScptUtl/pa33.htm

So the browsers do have a limitation as well. So 20 GB is for sure not possible with any browser currently available even if the server would be able to do so.

- Michael

Author:  kgnewikow [ 25. May 2011, 16:42 ]
Post subject:  Re: System Settings for Very Large File uploads

Hi Michael,

Thank you for the response.

Does the FTP mode of JFUploader behave like a regular FTP client, so it bypasses the browser limitations?

Or are you saying that JFUploader cannot upload files that are larger than those allowed by the browser, even in FTP mode?

Maybe my math is off, but

72000 seconds / 60 = 1200 minutes
1200 minutes / 60 = 20 hours

or is my calculation wrong?

Thank you!

Kevin

Author:  TinyWebGallery [ 25. May 2011, 16:46 ]
Post subject:  Re: System Settings for Very Large File uploads

FTP mode is only to create directories.

Flash can only use http uploads. So all this restrictions of servers and browsers do apply.
So the 2 GB is really a limit.

By the omy first question. Do you have a 64 bit php?

My calculation was wrong. I forgot the minutes ;).

- Michael

Author:  kgnewikow [ 25. May 2011, 17:20 ]
Post subject:  Re: System Settings for Very Large File uploads

Hi Michael,

Hmmmmm..... well, I guess that is why the current solution that the client uses is a JAVA-based application.

Thank you for that information, it is something that I should have researched more at the beginning of the project.

I am not sure about 64-bit PHP,

We are on 5.3.4 using OS X 10.6 (which is 64-bit, so I am assuming that it ships with the 64-bit PHP)

Is there a simple way for me to find out if this install is 64-bit?

(sorry to be ignorant about this)

Thank you!

Kevin

Author:  TinyWebGallery [ 25. May 2011, 17:26 ]
Post subject:  Re: System Settings for Very Large File uploads

the php info of you server should tell you if you have 64 bit.
But you might have because you where able to set the limit to > 2 GB. in 32 bit systems the setting till 4GB are interpretes as negative values and > 4 GB it fails.

You can still try with really high timeouts. I never had a 64 bit system. But there is still the browser issue.

A java client can split the files and put them together. The newest version of flash can this too but is has to load the whole file into memory and then it crashes there.

- Michael

Page 1 of 1 All times are UTC + 1 hour [ DST ]
Powered by phpBB® Forum Software © phpBB Group
http://www.phpbb.com/