Backup not uploading to remote destination

[yeelok]

Hi,

I have cPanel v84.0.14 running with additional destination on Amazon S3 enabled and validated. However, no backups were uploaded.

On the backup log, it said no transport:

[backup] Queuing transport of file: /home/backup/2019-11-27/accounts/quayside.tar.gz
[backup] no_transport = 0 .. and queueid = TQ:TaskQueue:31663

/usr/local/cpanel/logs/cpbackup/1574833447.log is attached.
/usr/local/cpanel/logs/cpbackup_transporter.log file does not exist.
no new log files in /usr/local/cpanel/logs/cpbackup_transporter folder

 

[cPanelLauren]

What's the output of the following?

cat /var/cpanel/backups/config

cat /var/cpanel/backups/backuplocation_hash.backup_destination

 

[yeelok]

/var/cpanel/backups/backuplocation_hash.backup_destination does not exist.

The content of /var/cpanel/backups/config is:

---
BACKUPACCTS: 'yes'
BACKUPBWDATA: 'no'
BACKUPDAYS: 0,1,2,3,4,5,6
BACKUPDIR: /home/backup
BACKUPENABLE: 'yes'
BACKUPFILES: 'yes'
BACKUPLOGS: 'no'
BACKUPMOUNT: 'no'
BACKUPSUSPENDEDACCTS: 'no'
BACKUPTYPE: compressed
BACKUP_DAILY_ENABLE: 'yes'
BACKUP_DAILY_RETENTION: 2
BACKUP_MONTHLY_DATES: 1
BACKUP_MONTHLY_ENABLE: 'no'
BACKUP_MONTHLY_RETENTION: 1
BACKUP_WEEKLY_DAY: 0
BACKUP_WEEKLY_ENABLE: 'no'
BACKUP_WEEKLY_RETENTION: 4
CHECK_MIN_FREE_SPACE: 1
DISABLE_METADATA: 'no'
ERRORTHRESHHOLD: 3
FORCE_PRUNE_DAILY: 0
FORCE_PRUNE_MONTHLY: 0
FORCE_PRUNE_WEEKLY: 0
GZIPRSYNCOPTS: --rsyncable
KEEPLOCAL: 1
LINKDEST: 0
LOCALZONESONLY: 'no'
MAXIMUM_RESTORE_TIMEOUT: 21600
MAXIMUM_TIMEOUT: 28800
MIN_FREE_SPACE: 10
MIN_FREE_SPACE_UNIT: percent
MYSQLBACKUP: both
POSTBACKUP: 'no'
PREBACKUP: -1
PSQLBACKUP: 'no'
REMOTE_RESTORE_STAGING_DIR: /backup

 

[cPanelLauren]

If that file doesn't exist then it would mean that you've not created/saved/ a remote backup destination. This would cause the transport to not even try to start.

 

[yeelok]

Oh my bad. The file does exist.

/var/cpanel/backups/auralabs_s3_UID_Wz1usVJnCT3wft_oSexN1Amu.backup_destination

---
aws_access_key_id: AKIATDFGN7ZS3FOLQI6C
bucket: auralabs
disabled: 0
folder: ''
id: Wz1usVJnCT3wft_oSexN1Amu
name: auralabs s3
password: <PASSWORD_HASH>
timeout: 30
type: AmazonS3
upload_system_backup: 1

 

[cPanelLauren]

Hello,

That looks good, can you give me the output of the following?

grep -r Failure /usr/local/cpanel/logs/cpbackup/

 

[yeelok]

Here it is:

[[email protected] ~]# grep -r Failure /usr/local/cpanel/logs/cpbackup/
/usr/local/cpanel/logs/cpbackup/1574445602.log:[2019-11-23 15:25:28 +0800] info [backup] Final state is Backup::PartialFailure (0)
/usr/local/cpanel/logs/cpbackup/1574445602.log:[2019-11-23 15:25:28 +0800] info [backup] Sent Backup::PartialFailure notification.
/usr/local/cpanel/logs/cpbackup/1574532002.log:[2019-11-24 15:07:55 +0800] info [backup] Final state is Backup::PartialFailure (0)
/usr/local/cpanel/logs/cpbackup/1574532002.log:[2019-11-24 15:07:55 +0800] info [backup] Sent Backup::PartialFailure notification.
/usr/local/cpanel/logs/cpbackup/1574618402.log:[2019-11-25 15:31:23 +0800] info [backup] Final state is Backup::PartialFailure (0)
/usr/local/cpanel/logs/cpbackup/1574618402.log:[2019-11-25 15:31:23 +0800] info [backup] Sent Backup::PartialFailure notification.

 

[cPanelLauren]

This would explain why the backups aren't being transported. backups for the 23-25th are partial failures. Not only will partially failed backups not be transported but they will not be removed from the server locally.

The log files listed should indicate what the issues were, feel free to post them here if you're unsure how to resolve them.

 

[yeelok]

Yes, those backups are having MySQL dump issue and have been fixed.

After 25th, all daily backups are success, but still not being transported.

Here is the latest log file for your reference. Please have a look.

 

[cPanelLauren]

Great, that is showing the backups are completing now and the job is being passed to the transporter. What is in the transport logs at /usr/local/cpanel/logs/cpabackup_transporter

 

[yeelok]

No new logs in /usr/local/cpanel/logs/cpabackup_transporter. The last one is generated at 27 Oct 2019.

The log file is too large and I cannot attach here. Please download it from Here.

Thanks.

 

[cPanelLauren]

Hello,


I removed the link as we discourage the use of 3rd party links. I did look at the log file. The transfer has no errors and shows successful transports to the Amazon S3 location.If there were an error this would have been output in the logs as it's essentially just an output of the process transaction. I'd suggest investigating the settings on the S3 bucket further - while we are happy to investigate further if you'd like to open a ticket, as far as the transaction occurring on the server there isn't anything out of place.

 

[yeelok]

Thanks. I have submitted a support ticket.