Problems with backup process

[craigedmonds]

How does the backup actually work?

Surely the logical sequence would be:

1. zip up /home/accountA to /home/backup/accountA.gzip
2. send contents of /home/backup/accountA.gzip to remote backup server
3. zip up /home/accountB to /home/backup/accountB.gzip
4. send contents of /home/backup/accountB.gzip to remote backup server
5. keep doing this until all accounts are backed up.

I am seeing issues since the introduction of the new backup system late 2013.

 

[cPanelMichael]

Hello

Could you let us know what specific issues you are encountering with the new backup system?

Thank you.

 

[craigedmonds]

Hello

Could you let us know what specific issues you are encountering with the new backup system?

Thank you.

I have a 256GB SSD where I have all the clients files and /home is 67% full.

I have configured the backup to backup to /home/backups as /var is only 20GB and is 80% full so not an option to run the backups there.

We then send the backups from /home/backups to the remote backup server via ftp.

When we are running the backup process I get warnings that /home/backups is at 100% and the backup disables itself and sometimes I have to manually delete the backup files from /home/backups.

 

[cPanelMichael]

The error message you have reported suggests the /home partition is reaching 100% capacity. If the existing usage is 67%, then it makes sense that backing up all of the accounts would result in 100% usage when storing backup archives on the same partition. Are you manually moving the backups to the remote server via FTP after a local backup generation completes? Or, are you using the built-in option to store backups on a remote destination with the cPanel backup system?

Thank you.

 

[craigedmonds]

The error message you have reported suggests the /home partition is reaching 100% capacity. If the existing usage is 67%, then it makes sense that backing up all of the accounts would result in 100% usage when storing backup archives on the same partition. Are you manually moving the backups to the remote server via FTP after a local backup generation completes? Or, are you using the built-in option to store backups on a remote destination with the cPanel backup system?

Thank you.

Well yes I realise thats whats happening but would logic not suggest that if the files are being zipped then surely 30% free space should be enough to hold the temporary backup files?

A logical sequence/process should be:

1. zip up /home/accountA to /home/backup/accountA.gzip
2. send contents of /home/backup/accountA.gzip to remote backup server
3. zip up /home/accountB to /home/backup/accountB.gzip
4. send contents of /home/backup/accountB.gzip to remote backup server
5. keep doing this until all accounts are backed up.

Or is there a reason why cpanel backup backs up everything and then moves the backup?

 

[cPanelMichael]

This depends on how exactly you have configured backups. Are you manually moving the backups to the remote server via FTP after a local backup generation completes? Or, are you using the built-in option to store backups on a remote destination with the cPanel backup system? The reason I ask is because you stated:

We then send the backups from /home/backups to the remote backup server via ftp.

This statement indicates that you might be manually moving the backups to the remote server.

Thank you.

 

[craigedmonds]

Or, are you using the built-in option to store backups on a remote destination with the cPanel backup system?

We are using all the built in options.

 

[cPanelMichael]

The existing backup system is not designed to copy over the archive to the remote FTP server before initiating the next archive generation. There is an open feature request that you can vote and add your input to here:

Immediate Transfer of Remote Backup Archives | cPanel Feature Requests

Thank you.