Backup problem (cpbackup)

[de_Stan]

Hello,

We are encountering a problem with our backup process. We have configured a daily backup plan for all user accounts and an SFTP backup destination through WHM which is validated.
Although we see can from the logs that the backup is completed successfully (localy), sometimes some of the backup files cannot be transferred to the remote destination and from the logs we see an

Upload attempt failed: Couldn't open remote file 'filepathhere.tar.gz': Quota exceeded at /usr/local/cpanel/Cpanel/LoggerAdapter.pm line 27

This can happen from time to time and not for a specific account.
I can verify the disk of the server is not full, we would get a backup abort error and also the option 'Check Available Disk Space' is checked.
I can also verify the destination is not full, disk space and inodes.
Considering what Quota might mean is this case i checked a user's account to be at 25GB quota limit, but only 1GB used.

Thank you in advance.

 

[atgyuric]

If target SFTP server is running on Windows then use Cygwin and disable built in windows services. I run into the same problem with SFTP server. Validate, key etc works well on cpanel test, but failed on backup with your error. The problem is unix and windows character set is different i think.

 

[cPanelLauren]

Is this coming from cpbackup? That would signify the legacy backup system.

What's present in the transport logs? They're located at/usr/local/cpanel/logs/cpbackup_transporter/

 

[de_Stan]

If target SFTP server is running on Windows then use Cygwin and disable built in windows services. I run into the same problem with SFTP server. Validate, key etc works well on cpanel test, but failed on backup with your error. The problem is unix and windows character set is different i think.

Well it is a third party service but i don't know if it is running on Windows to be honest. The thing is that sometimes it works, sometimes it fails.

Is this coming from cpbackup? That would signify the legacy backup system.

What's present in the transport logs? They're located at/usr/local/cpanel/logs/cpbackup_transporter/

Yes, it's from cpbackup. Here is some more info from the yesterday's log.

info [cpbackup_transporter] cpbackup_transporter - Processing next task
info [cpbackup_transporter] Instantiating Object
info [cpbackup_transporter] Starting a "copy" operation on the "DESTINATION" destination ID "XXXXXXXXX".
info [cpbackup_transporter] Base path for destination is DESTINATION_PATH
info [cpbackup_transporter] Validating destination path DESTINATION_PATH
info [cpbackup_transporter] Path exists
info [cpbackup_transporter] Uploading account backup LOCAL_PATH/xxxxx.tar.gz to DESTINATION_PATH/xxxxx.tar.gz (from LOCAL_PATH/xxxxx.tar.gz)

info [cpbackup_transporter] Attempting to upload LOCAL_PATH/xxxxx.tar.gz to DESTINATION_PATH/xxxxx.tar.gz for destination:  DESTINATION

info [cpbackup_transporter] Upload attempt #1 starting for LOCAL_PATH/xxxxx.tar.gz to DESTINATION_PATH/xxxxx.tar.gz for destination:  DESTINATION

warn [cpbackup_transporter] Upload attempt failed: Couldn't open remote file 'DESTINATION_PATH/xxxxx.tar.gz': Quota exceeded at /usr/local/cpanel/Cpanel/LoggerAdapter.pm line 27.
    Cpanel::LoggerAdapter::warn(Cpanel::LoggerAdapter=HASH(0x161c650), "Upload attempt failed: Couldn't open remote file 'DESTINATION"...) called at /usr/local/cpanel/Cpanel/Backup/Queue.pm line 658
    Cpanel::Backup::Queue::transport_backup::attempt_to_upload_file(Cpanel::Backup::Queue::transport_backup=HASH(0x1411918), Cpanel::Transport::Files::SFTP=HASH(0x2c08020), "LOCAL_PATH/xxxxx.tar.gz", "DESTINATION_PATH/xxxxx.tar.gz", Cpanel::LoggerAdapter=HASH(0x161c650)) called at /usr/local/cpanel/Cpanel/Backup/Queue.pm line 333
    Cpanel::Backup::Queue::transport_backup::process_task(Cpanel::Backup::Queue::transport_backup=HASH(0x1411918), Cpanel::TaskQueue::Task=HASH(0x2cf8f38), Cpanel::LoggerAdapter=HASH(0x161c650)) called at /usr/local/cpanel/Cpanel/TaskQueue.pm line 635
    eval {...} called at /usr/local/cpanel/Cpanel/TaskQueue.pm line 638
    Cpanel::TaskQueue::[B]ANON[/B]() called at /usr/local/cpanel/Cpanel/StateFile.pm line 241
    eval {...} called at /usr/local/cpanel/Cpanel/StateFile.pm line 241
    Cpanel::StateFile::Guard::call_unlocked(Cpanel::StateFile::Guard=HASH(0x2bfdce8), CODE(0x2bfdb08)) called at /usr/local/cpanel/Cpanel/TaskQueue.pm line 643
    Cpanel::TaskQueue::process_next_task(Cpanel::TaskQueue=HASH(0x2479fb8)) called at /usr/local/cpanel/bin/cpbackup_transporter line 168
    eval {...} called at /usr/local/cpanel/bin/cpbackup_transporter line 166

 

[cPanelLauren]

Hello,

I don't see anything in here besides the quota has been exceeded for the account. I'd suggest you open a ticket so that we can take a closer look at the issue.

 

[de_Stan]

Hello @cPanelLauren,

Can you please clarify what kind of quota has been exceeded? I'm looking a particular account at the moment which failed to be uploaded yesterday. From the metrics I can see the Bandwidth usage is at 1% (monthly), and Disk usage at 39.4%. So these quotas are not the case. What else can i look into?

 

[cPanelLauren]

Hello @de_Stan

Do you have account quotas in place for the cPanel accounts? That would be what you'd want to look at first, otherwise, I wouldn't have a way to know without looking at the server which is why I requested you open a ticket.

 

[de_Stan]

Turns out the issue was with the third party service. Once we changed we never had any problems.
Thank you for your time!