Please whitelist cPanel in your adblocker so that you’re able to see our version release promotions, thanks!

The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Backups Staying On Server

Discussion in 'Data Protection' started by denverdataman, Nov 22, 2016.

Tags:
  1. denverdataman

    denverdataman Member

    Joined:
    Jun 21, 2016
    Messages:
    12
    Likes Received:
    1
    Trophy Points:
    3
    Location:
    Denver
    cPanel Access Level:
    Root Administrator
    I have seen that my disk is getting up to almost 90% full. Looking at the file system it looks like backups are taking lots of space. I do not understand this because I do not have the Retain backups in the default backup directory option selected in WHM.

    Here is a part of the results I am seeing when I look at the files.

    61G /backup
    51G /backup/weekly
    48G /var/lib/mysql.bkp
    Largest Files:
    22586 MB /var/lib/mysql.bkp/ibdata1.bkp
    14872 MB /var/lib/mysql/xxx_drupalworking6/watchdog.ibd
    14872 MB /var/lib/mysql.bkp/xxx_drupalworking6/watchdog.ibd
    7096 MB /backup/weekly/2016-11-20/accounts/buixxxtar.gz
    7068 MB /backup/weekly/2016-11-13/accounts/buixxx.tar.gz
    7033 MB /backup/weekly/2016-11-06/accounts/buixxx.tar.gz
    6921 MB /backup/weekly/2016-10-30/accounts/buixxx.tar.gz
    6919 MB /backup/monthly/2016-11-01/accounts/buixx.tar.gz
    6835 MB /backup/weekly/2016-10-23/accounts/buixxx.tar.gz
    4096 MB /usr/tmpDSK
    1880 MB /backup/weekly/2016-11-20/accounts/xxxfoundation.tar.gz
    1870 MB /backup/weekly/2016-10-23/accounts/xxxfoundation.tar.gz
    1868 MB /backup/weekly/2016-10-30/accounts/xxxfoundation.tar.gz
    1865 MB /backup/monthly/2016-11-01/accounts/xxxfoundation.tar.gz
    1764 MB /backup/weekly/2016-11-13/accounts/xxxo.tar.gz
    1764 MB /backup/weekly/2016-11-20/accounts/xxxo.tar.gz
    1764 MB /backup/weekly/2016-11-06/accounts/xxxo.tar.gz


    I am just trying to please understand why the backup files are being retained.

    Thanks,
    Steve
     
  2. Infopro

    Infopro cPanel Sr. Product Evangelist
    Staff Member

    Joined:
    May 20, 2003
    Messages:
    15,766
    Likes Received:
    313
    Trophy Points:
    433
    Location:
    Pennsylvania
    cPanel Access Level:
    Root Administrator
    Twitter:
    Are your backups being transferred to another location or do you wish to disable backups from running?
     
  3. denverdataman

    denverdataman Member

    Joined:
    Jun 21, 2016
    Messages:
    12
    Likes Received:
    1
    Trophy Points:
    3
    Location:
    Denver
    cPanel Access Level:
    Root Administrator
    When I look at /usr/local/cpanel/logs/cpbackup_transporter I see no issues.

    Thanks,
    Steve
     
  4. denverdataman

    denverdataman Member

    Joined:
    Jun 21, 2016
    Messages:
    12
    Likes Received:
    1
    Trophy Points:
    3
    Location:
    Denver
    cPanel Access Level:
    Root Administrator
    Sorry, a better response would be I want them to go to S3 and then be removed from my server. If the server dies having backups on the server will not help me. I would love having the last backup but I do not see settings to be that granular. Right now the issue is that once files go to Amazon (seen in /usr/local/cpanel/logs/cpbackup_transporter) they are not always being deleted from the server.

    Thanks,
    Steve
     
  5. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    38,658
    Likes Received:
    1,425
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Hello,

    The following case was implemented in cPanel version 60:

    Fixed case CPANEL-7446: Don't prune old backups if backup was a partial failure.

    This is to ensure backups aren't pruned in situations where a partial backup failure occurs. Could you review the backup logs in /usr/local/cpanel/logs/cpbackup/ to see if you notice any entries for "PartialFailure"? If so, you'd want to review the logs to see which accounts partially failed to determine what happened.

    Thanks!
     
  6. denverdataman

    denverdataman Member

    Joined:
    Jun 21, 2016
    Messages:
    12
    Likes Received:
    1
    Trophy Points:
    3
    Location:
    Denver
    cPanel Access Level:
    Root Administrator
    I used "# grep -r "PartialFailure" " to find this in the file and no results are returned.

    I checked that the command works by using the word "info".

    Thanks,
    Steve
     
  7. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    38,658
    Likes Received:
    1,425
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Could you verify which file you checked? You should check the backup logs as opposed to the transport logs:

    /usr/local/cpanel/logs/cpbackup/*

    Also, do you notice any additional errors or failures in the backup logs?

    Thank you.
     
  8. denverdataman

    denverdataman Member

    Joined:
    Jun 21, 2016
    Messages:
    12
    Likes Received:
    1
    Trophy Points:
    3
    Location:
    Denver
    cPanel Access Level:
    Root Administrator
    When looking at these logs I do see PartialFailure in the log.

    For example:
    1480237201.log:[2016-11-27 02:22:18 -0700] info [backup] Final state is Backup::PartialFailure (0)
    1480237201.log:[2016-11-27 02:22:18 -0700] info [backup] Sent Backup::PartialFailure notification.

    Can I dig into what happened? Can I get an alert when this happens?

    Thanks,
    Steve
     
  9. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    38,658
    Likes Received:
    1,425
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Hello,

    You can browse through a specific backup log using the "cat" or "view" command to see the specific error or failure messages related to the accounts.

    You can also configure "Backup Failure" notification importance via "WHM >> Contact Manager". Ensure the "Communication Type" tab is configured to send you notifications via your preferred method.

    Thank you.
     
  10. denverdataman

    denverdataman Member

    Joined:
    Jun 21, 2016
    Messages:
    12
    Likes Received:
    1
    Trophy Points:
    3
    Location:
    Denver
    cPanel Access Level:
    Root Administrator
    I think there are three issues going on here.

    1. I see there are some issues that the system is seeing as a partial failure for the backup. I will address these. The system is still making tar files

    2. The bigger problem is that it appears that the tar files may not be leaving the server to go to S3. The makes me very nervous. The strange part is there are a significant number of files on S3 going back to October. On a side note, the pruning built into WHM Backup is not working.

    3. Can I delete the old backup files that are on the HDD?

    Thanks,
    Steve
     
  11. Infopro

    Infopro cPanel Sr. Product Evangelist
    Staff Member

    Joined:
    May 20, 2003
    Messages:
    15,766
    Likes Received:
    313
    Trophy Points:
    433
    Location:
    Pennsylvania
    cPanel Access Level:
    Root Administrator
    Twitter:
    Sure you can.
     
  12. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    38,658
    Likes Received:
    1,425
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Hello,

    It's by design that backups aren't pruned in situations where a partial backup failure occurs. Could you address the issues on any of the accounts that are failing during the backup generation and then let us know if the issue continues?

    Thank you.
     
Loading...

Share This Page