backup solution required

[ltoso]

Hi,
i need a solution to backup about 1800GB data on WHm/cpanel to a remote server at a different datacenter every week, do you think whm auto backup can do this every week, because the total server space on the server is like 2GB so have just 140Gb of space with me, i am little confused when whm backups data account by account and then upload it through ftp to remote server. does it do it like this

1) backup create tar.gz file for one account
2) upload it to remote server
3) Remove local file
go back to step 1 for 2nd account on list

this way it might be possible because we will not be able to store 1800Gb of tar.gz files locally as we have just 140GB on the hard drive if it backups like this

1) backup all accounts locally in tar.gz
2) uplaod each one to ftp
3) remove them all at once

if the 1st scanerio is true then the only other issue is how much days it will take to backup 1800Gb to remote server, the server is having good config , dual core 4GB RAM, RAID-10, but it does have more than 50% cpu time most of the time

or it could be done like

backup system files/password of all accounts,
and then use rsync to synchronize every week to remote server, is this type of backup possible on cpanel

what do you suggest guys, thanx for taking out time to read my post, does anybody has backed up that much amount of data from single server every week

please recommend

 

[cPanelMichael]

Hello

Only one backup archive at a time is stored locally when you have your backups configured to a remote destination. Each temporary backup archive on the local server is removed after it's uploaded to the remote destination. 1800G could take up to or longer than 24 hours to complete. Have you considered backing up the accounts once a week instead of daily?

To note, cPanel 11.38 introduces some improvements to the backup system that may interest you. You can find more information on it at:

11.38 - Improved Backup System - Release Notes

It's currently only available on the "CURRENT" and "EDGE" build tiers, so you will likely want to wait until it's pushed to the "RELEASE" build tier before upgrading.

Thank you.

 

[ltoso]

Hi,
thanx Cpanel Michael for reply, i was thinking like backing up the database everyday and complete accounts every week, can we schedule both types from the whm panel simultaneously, i mean can we schedule both types of backups on the same machine using whm panel,

You must have heard somebody backup 1800Gb or more of cpanel accounts on server, can you give like max time it could take to backup complete accounts total data 1800Gb

is there a provision in cpanel where it takes care to delay the backup when the system is on high load.

i have heard that now cpanel/whm has the provision where we can run complete server backup program not as root but as the name of the user of the account, so everytime a different account is backed up it will change itself to the username of the account, so in case i am using cloud linux it will count the cpu being used by the backup into that user account making the backup utility cpu usage not affecting any other user on server is that correct.

Please recommend, thanx again for going through my post

 

[cPanelMichael]

i was thinking like backing up the database everyday and complete accounts every week, can we schedule both types from the whm panel simultaneously, i mean can we schedule both types of backups on the same machine using whm panel

There are currently no options available to backup databases on a different schedule than the accounts. You are welcome to use a custom solution to backup the databases separately, or open a feature request for this at:

Submit A Feature Request

You must have heard somebody backup 1800Gb or more of cpanel accounts on server, can you give like max time it could take to backup complete accounts total data 1800Gb

I'm sure there are servers that utilize that much data and have backups enabled. However, there is no true way to determine how long it will take due to all of the hardware/network factors involved. You will need to generate the backups once or twice to get an accurate time frame for completion.

is there a provision in cpanel where it takes care to delay the backup when the system is on high load.

In "WHM Home » Server Configuration » Tweak Settings", under the "Stats and Logs" tab, you can adjust the following option:

"Extra CPUs for server load"

This controls the load average above the number of CPUs at which cpuwatch, cpanellogd, backups, and CPU stats consider the system to be in a critical load state. For example, a server with 4 physical CPUs and a value of 2 in this field will be considered “critical” in these cases once the load reaches 6. The processes will temporarily stop when the load is considered critical.

so in case i am using cloud linux it will count the cpu being used by the backup into that user account making the backup utility cpu usage not affecting any other user on server is that correct.

I recommend asking this question on our Cloud Linux forums at:

cPanel - CloudLinux Forums

Thank you.