[Case 72777] Pruning Remote Backups Fails

[LAZer]

hi , i have changed my legacy backup to the new backup system ,
i have 3 days per week enabled , retain 2 backups , and monthly backup is enabled . also backup system configurations is enabled.

in my remote ftp server it backups the files successfully. the problem is that it doesn't delete the old daily backups and my backup space fills with duplicate files every week.

i have 2 directories in monthly , 08.01 and 07.15 ,
and 8 directories in the directory of backups , for daily backups .

so now i have 10 copies of server backups without it deleting the old backups.

in the log of backup i dont see any remove , delete , rm , log lines. how can i fix this problem ?

also it is storing configuration backup files in /backup instead of the directory i set for backups.
and also why can't us send configuration backups to another servers ? is it security related reason for this?

 

[cPanelMichael]

Hello

Check to see if the following option is enabled in "WHM Home » Backup » Backup Configuration":

"Retain backups in the default backup directory."

Per it's description:

This option will keep backups in the default local backup directory even after the backups have been transferred to another destination. If this option is not selected, backups will be deleted after being moved to another destination.

Is the storage location issue on the remote FTP server or the local server? Could you clarify the specific type of data you are referring to when you mention "configuration backups"?

Thank you.

 

[LAZer]

my problem is the same as this post :
http://forums.cpanel.net/f49/new-backup-questions-357191.html

on local server backup is working fine , but on remote ftp it doesnt delete the old backup directories.
it should save only 2 copies but there are more that 10 copies on the remote ftp server now.

also in the log of
/usr/local/cpanel/logs/cpbackup_transporter.log

i see some errors both for timeout and some other errors that says directory is not empty !
so it tries to delete but as the old backup files are still there it cant delete the directory.

[2013-08-11 05:18:46 +0430] warn [cpbackup_transporter] Error pruning 2013backups/2013-08-06 from [remote ftp]: 2013backups/2013-08-06: Directory not empty

at /usr/local/cpanel/Cpanel/LoggerAdapter.pm line 26
Cpanel::LoggerAdapter::warn(Cpanel::LoggerAdapter=HASH(0x1e8ebe58), 'Error pruning 2013backups/2013-08-06 from [remoteftp]: 2013backups/2013-08-06: Directory not empty\x0A') called at /usr/local/cpanel/Cpanel/Backup/Queue.pm line 285
Cpanel::Backup::Queue::transport_backup::attempt_to_prune_destination(Cpanel::Backup::Queue::transport_backup=HASH(0x1e8c1de8), Cpanel::Transport::Files::FTP=HASH(0x1f1c4118), 2, Cpanel::LoggerAdapter=HASH(0x1e8ebe58)) called at /usr/local/cpanel/Cpanel/Backup/Queue.pm line 104
Cpanel::Backup::Queue::transport_backup::process_task(Cpanel::Backup::Queue::transport_backup=HASH(0x1e8c1de8), cPanel::TaskQueue::Task=HASH(0x1f1c3d70), Cpanel::LoggerAdapter=HASH(0x1e8ebe58)) called at /usr/local/cpanel/3rdparty/perl/514/lib64/perl5/cpanel_lib/cPanel/TaskQueue.pm line 571
eval {...} called at /usr/local/cpanel/3rdparty/perl/514/lib64/perl5/cpanel_lib/cPanel/TaskQueue.pm line 574
cPanel::TaskQueue::__ANON__() called at /usr/local/cpanel/3rdparty/perl/514/lib64/perl5/cpanel_lib/cPanel/StateFile.pm line 246
eval {...} called at /usr/local/cpanel/3rdparty/perl/514/lib64/perl5/cpanel_lib/cPanel/StateFile.pm line 246
cPanel::StateFile::Guard::call_unlocked(cPanel::StateFile::Guard=HASH(0x1f107170), CODE(0x1f36e1c0)) called at /usr/local/cpanel/3rdparty/perl/514/lib64/perl5/cpanel_lib/cPanel/TaskQueue.pm line 579
cPanel::TaskQueue::process_next_task(cPanel::TaskQueue=HASH(0x1f1070f8)) called at /usr/local/cpanel/bin/cpbackup_transporter line 89
eval {...} called at /usr/local/cpanel/bin/cpbackup_transporter line 87
[2013-08-11 05:18:47 +0430] info [cpbackup_transporter] cPanel Backup Transporter Queue Daemon is being stopped.

 

[cPanelMichael]

Could you open a support ticket so we can take a closer look?

Submit A Ticket

This is similar to an issue reported on internal case 72777, but it's better that we investigate it directly.

Thank you.

 

[LAZer]

i still have this problem , and ticket id is: 4335297

on the other similiar topic they said that the problem is with the remote server ftp permissions.
but in my case , that remote ftp server was working fine with backup deletion in the old backup system.
with the new backup system i don't see any tries for deleting the previous directories in the log.

 

[cPanelMichael]

To update, this was determined to be related to an internal case where pruning remote backups can fail when the FTP directory listing format is different than expected. For reference, the case number is 72777.

Thank you.

 

[bruceleeon]

What was the resolution for this? I have the same affliction/.

 

[cPanelMichael]

What was the resolution for this? I have the same affliction/.

Case 72777 seeks to address an issue where pruning remote backups can fail when the FTP directory listing format is different than expected. This case is still open at this time, and there is currently no time frame available for a resolution.

Thank you.

 

[goodmove]

Hi Michael: What is the URL for this case?

 

[cPanelMichael]

Hi Michael: What is the URL for this case?

Our cases are internal. You can monitor the change log to determine when a resolution has been released:

cPanel - Change Log

Thank you.

 

[johnburk]

Has this been fixed? Remote backups do not get deleted, despite the setting to only keep them for 4 days.

 

[LAZer]

Has this been fixed? Remote backups do not get deleted, despite the setting to only keep them for 4 days.

not yet ,
now i even installed a new vps for my backups , i configured it myself , installed zpanel in it , the old backup system ( legacy ) works just fine , but new backup system , creates and sends backup to remote ftp space but cannot delete the uploaded backups from remote server.
seems that it doesnt simply delete with a command like rm , it checks some size or date before deleting and something is changing that it cannot detect and delete the uploaded files.
use legacy backup as the support suggested it to me too .

 

[cPanelMichael]

Internal case 72777 has not yet been addressed. It's still an active case with our development team.

Thank you.

 

[johnburk]

not yet ,
now i even installed a new vps for my backups , i configured it myself , installed zpanel in it , the old backup system ( legacy ) works just fine , but new backup system , creates and sends backup to remote ftp space but cannot delete the uploaded backups from remote server.
seems that it doesnt simply delete with a command like rm , it checks some size or date before deleting and something is changing that it cannot detect and delete the uploaded files.
use legacy backup as the support suggested it to me too .

Too bad this has not been fixed.

For me the problem with the legacy backup is that it is very slow. The legacy backup can take up to 12 hours to backup less than 30GB of compressed data, while the new one takes about 4 hours.

The problem with the current cannot delete bug is that if you have limited external backup space, the new backups will fail due to limited disk space.

 

[preylude]

To add to info for your internal case, I'm backing up 3 different CPanel servers with the new backup system to the same FTP.
1. They all just retain one day and have the exact same backup configuration
2. They are all deleting the previous ones properly
3. One server just started sending a nightly email on Mar 5:
Subject: [backup] Backup transport errors on (server address)
The following errors occurred while transporting your backup files:
Unable to prune transport “(transport name)”
4. NOTE: The backup still worked fine -- ie. it deleted the previous day

Server with the error: CENTOS 5.9 i686 virtuozzo – WHM 11.42.0 (build 19)
Server with no errors: CENTOS 5.8 i686 virtuozzo – WHM 11.42.0 (build 19)
Server with no errors: CENTOS 5.10 i686 xenpv – WHM 11.42.0 (build 19)

 

[justinkas]

WHM 11.42.0 (build 22)

I too have started having these issues about a week and a half ago. I have had my cPanel/WHM server up for about a year and have just started getting nightly error emails about backups to my offsite FTP cold storage location as follows:

[backup] Backup transport errors on 'server name'

The following errors occurred while transporting your backup files: Unable to prune transport “Server Storage (my FTP storage name)”

and:

The following errors occurred while transporting your backup files:

Unable to send “/backup/2014-03-16/system_files.tar” to destination “Server Storage”
Unable to send “/backup/2014-03-16/system_files.tar” to destination “Server Storage”
Unable to send “/backup/2014-03-16/accounts/glzzth.tar.gz” to destination “Server Storage”
Unable to send “/backup/2014-03-16/accounts/glzzth.tar.gz” to destination “Server Storage”
Unable to send “/backup/2014-03-16/accounts/glzzth.tar.gz” to destination “Server Storage”
Unable to send “/backup/2014-03-16/accounts/glzzth.tar.gz” to destination “Server Storage”
Unable to prune transport “Server Storage”
Unable to prune transport “Server Storage”

This is a nightly error...Thanks!

 

[johnburk]

I found out that it does delete some files but the gives up. Is it possible to setup a cron job where rather than trying 1x a day, it can try to do it every hour?

 

[cPanelMichael]

A resolution for case 72777 is included as of cPanel version 11.42.1.1. This version is currently only released to the "Current" and "Edge" build tiers, but it's expected to make it's way to the "Release" and "Stable" build tiers in the coming weeks.

Thank you.

 

[Cloud9]

I'm on 11.42.1 (Build 6) and have this same problem

 

[cPanelMichael]

Could you verify the exact problem you are having so we can confirm if it's related to this case?

Thank you.