cPanel Backup - FTP Uploads Very Slow

[deadend]

Hi Guys,

I am troubleshooting why the FTP upload portion of the cPanel backup process is so "slow".

In short, we have setup the new cPanel backup process to utilize a brand backup server recently deployed in Buffalo, New York to use as a offsite backup server for our cPanel servers stacked up in Chicago, Illinois.

I have configured the cPanel backup tool to upload each of the account backups via FTP & validated the remote FTP server via the cPanel validation tool.

I manually started the cPanel backups via SSH and then checked the FileZilla FTP server to see how the speeds are looking (The new backup server replaced our older backup server in the UK as we were under the impression the distance from Chicago to the UK was part of the "slow" upload issue.). To my dismay I found the upload speeds ranging from 100KB/s to 400KB/s which is FAR lower than I expected.

I have performed the following troubleshooting:

1) Downloaded a file via http from the cPanel server to the backup server (4GB test file) - 2MB/s to 5MB/s
2) Uploaded a test file via ssh & ftp from the cPanel server to the backup server (4GB test file) - 2MB/s to 4MB/s
3) Checked the nic's & switch ports on both the cPanel server & backup server - no errors

As it stands right now I an nearly 100% certain there is either an issue with the cPanel backup script itself or a combination of the backup script & cloudlinux.

Any ideas?

Thanks is advance!

(Currently we only have one cPanel server we can test against due to the other nodes being in full production.)

cPanel Server Specs:
Intel Xeon E3-1240 V2
32GB of RAM
6x 1TB WD RE4's - RAID 10
2x 120GB Intel 520 SSD's
LSI 9260-8i w/BBU & CacheCade

Backup Server Specs:
Intel Xeon E3-1270 V3
16GB of RAM
8x 4TB WD RE4's - RAID 5
LSI 9271-8i w/CacheVault
2x 1Gbit Nic's (Bonded, LACP)
Windows Server 2012 R2 Standard, x64
FileZilla FTP Server (Latest)

 

[cPanelMichael]

Hello

Have you tried testing with other cPanel servers in the same or different data centers to that same backup server to see if you get different results? It seems like it might be an issue with the FTP transfer itself as opposed to the cPanel backup script.

Thank you.

 

[deadend]

Hello

Have you tried testing with other cPanel servers in the same or different data centers to that same backup server to see if you get different results? It seems like it might be an issue with the FTP transfer itself as opposed to the cPanel backup script.

Thank you.

Hi Michael,

Thanks for the reply!

I have done quite few uploaded tests to the FTP backup server from around the USA and in general I see 2-40MB/s when uploading via command prompt (SSH).

The FTP upload from the cPanel backup script to the backup server I have found varies dramatically as it uploads the each of the account backups. When I first posts 200KB/s was the fastest transfer I saw, however I have come to monitor that some of the backups will upload at 2-5MB/s while the very next one will struggle to get back 200KB/s.

Overall, very odd.

I have tested the upload from the cPanel server to the backup server using command prompt FTP and I am unable to replicate the slow, then fast, then slow, then fast, etc. - everyone I do is the normal "fast" 2-5MB/s.

 

[cPanelMichael]

Feel free to open a support ticket so we can take a closer look and test further. You can post the ticket number here so we can update this thread with the outcome.

Thank you.