Please whitelist cPanel in your adblocker so that you’re able to see our version release promotions, thanks!

The Community Forums

Interact with an entire community of cPanel & WHM users!

Backups Staying On Server

Discussion in 'Data Protection' started by denverdataman, Nov 22, 2016.

Tags:
  1. denverdataman

    denverdataman Active Member

    Joined:
    Jun 21, 2016
    Messages:
    32
    Likes Received:
    1
    Trophy Points:
    8
    Location:
    Denver
    cPanel Access Level:
    Root Administrator
    I have seen that my disk is getting up to almost 90% full. Looking at the file system it looks like backups are taking lots of space. I do not understand this because I do not have the Retain backups in the default backup directory option selected in WHM.

    Here is a part of the results I am seeing when I look at the files.

    61G /backup
    51G /backup/weekly
    48G /var/lib/mysql.bkp
    Largest Files:
    22586 MB /var/lib/mysql.bkp/ibdata1.bkp
    14872 MB /var/lib/mysql/xxx_drupalworking6/watchdog.ibd
    14872 MB /var/lib/mysql.bkp/xxx_drupalworking6/watchdog.ibd
    7096 MB /backup/weekly/2016-11-20/accounts/buixxxtar.gz
    7068 MB /backup/weekly/2016-11-13/accounts/buixxx.tar.gz
    7033 MB /backup/weekly/2016-11-06/accounts/buixxx.tar.gz
    6921 MB /backup/weekly/2016-10-30/accounts/buixxx.tar.gz
    6919 MB /backup/monthly/2016-11-01/accounts/buixx.tar.gz
    6835 MB /backup/weekly/2016-10-23/accounts/buixxx.tar.gz
    4096 MB /usr/tmpDSK
    1880 MB /backup/weekly/2016-11-20/accounts/xxxfoundation.tar.gz
    1870 MB /backup/weekly/2016-10-23/accounts/xxxfoundation.tar.gz
    1868 MB /backup/weekly/2016-10-30/accounts/xxxfoundation.tar.gz
    1865 MB /backup/monthly/2016-11-01/accounts/xxxfoundation.tar.gz
    1764 MB /backup/weekly/2016-11-13/accounts/xxxo.tar.gz
    1764 MB /backup/weekly/2016-11-20/accounts/xxxo.tar.gz
    1764 MB /backup/weekly/2016-11-06/accounts/xxxo.tar.gz


    I am just trying to please understand why the backup files are being retained.

    Thanks,
    Steve
     
  2. Infopro

    Infopro cPanel Sr. Product Evangelist
    Staff Member

    Joined:
    May 20, 2003
    Messages:
    16,518
    Likes Received:
    425
    Trophy Points:
    583
    Location:
    Pennsylvania
    cPanel Access Level:
    Root Administrator
    Twitter:
    Are your backups being transferred to another location or do you wish to disable backups from running?
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  3. denverdataman

    denverdataman Active Member

    Joined:
    Jun 21, 2016
    Messages:
    32
    Likes Received:
    1
    Trophy Points:
    8
    Location:
    Denver
    cPanel Access Level:
    Root Administrator
    When I look at /usr/local/cpanel/logs/cpbackup_transporter I see no issues.

    Thanks,
    Steve
     
  4. denverdataman

    denverdataman Active Member

    Joined:
    Jun 21, 2016
    Messages:
    32
    Likes Received:
    1
    Trophy Points:
    8
    Location:
    Denver
    cPanel Access Level:
    Root Administrator
    Sorry, a better response would be I want them to go to S3 and then be removed from my server. If the server dies having backups on the server will not help me. I would love having the last backup but I do not see settings to be that granular. Right now the issue is that once files go to Amazon (seen in /usr/local/cpanel/logs/cpbackup_transporter) they are not always being deleted from the server.

    Thanks,
    Steve
     
  5. cPanelMichael

    cPanelMichael Technical Support Community Manager
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    45,214
    Likes Received:
    1,937
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Twitter:
    Hello,

    The following case was implemented in cPanel version 60:

    Fixed case CPANEL-7446: Don't prune old backups if backup was a partial failure.

    This is to ensure backups aren't pruned in situations where a partial backup failure occurs. Could you review the backup logs in /usr/local/cpanel/logs/cpbackup/ to see if you notice any entries for "PartialFailure"? If so, you'd want to review the logs to see which accounts partially failed to determine what happened.

    Thanks!
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  6. denverdataman

    denverdataman Active Member

    Joined:
    Jun 21, 2016
    Messages:
    32
    Likes Received:
    1
    Trophy Points:
    8
    Location:
    Denver
    cPanel Access Level:
    Root Administrator
    I used "# grep -r "PartialFailure" " to find this in the file and no results are returned.

    I checked that the command works by using the word "info".

    Thanks,
    Steve
     
  7. cPanelMichael

    cPanelMichael Technical Support Community Manager
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    45,214
    Likes Received:
    1,937
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Twitter:
    Could you verify which file you checked? You should check the backup logs as opposed to the transport logs:

    /usr/local/cpanel/logs/cpbackup/*

    Also, do you notice any additional errors or failures in the backup logs?

    Thank you.
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  8. denverdataman

    denverdataman Active Member

    Joined:
    Jun 21, 2016
    Messages:
    32
    Likes Received:
    1
    Trophy Points:
    8
    Location:
    Denver
    cPanel Access Level:
    Root Administrator
    When looking at these logs I do see PartialFailure in the log.

    For example:
    1480237201.log:[2016-11-27 02:22:18 -0700] info [backup] Final state is Backup::PartialFailure (0)
    1480237201.log:[2016-11-27 02:22:18 -0700] info [backup] Sent Backup::PartialFailure notification.

    Can I dig into what happened? Can I get an alert when this happens?

    Thanks,
    Steve
     
  9. cPanelMichael

    cPanelMichael Technical Support Community Manager
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    45,214
    Likes Received:
    1,937
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Twitter:
    Hello,

    You can browse through a specific backup log using the "cat" or "view" command to see the specific error or failure messages related to the accounts.

    You can also configure "Backup Failure" notification importance via "WHM >> Contact Manager". Ensure the "Communication Type" tab is configured to send you notifications via your preferred method.

    Thank you.
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  10. denverdataman

    denverdataman Active Member

    Joined:
    Jun 21, 2016
    Messages:
    32
    Likes Received:
    1
    Trophy Points:
    8
    Location:
    Denver
    cPanel Access Level:
    Root Administrator
    I think there are three issues going on here.

    1. I see there are some issues that the system is seeing as a partial failure for the backup. I will address these. The system is still making tar files

    2. The bigger problem is that it appears that the tar files may not be leaving the server to go to S3. The makes me very nervous. The strange part is there are a significant number of files on S3 going back to October. On a side note, the pruning built into WHM Backup is not working.

    3. Can I delete the old backup files that are on the HDD?

    Thanks,
    Steve
     
  11. Infopro

    Infopro cPanel Sr. Product Evangelist
    Staff Member

    Joined:
    May 20, 2003
    Messages:
    16,518
    Likes Received:
    425
    Trophy Points:
    583
    Location:
    Pennsylvania
    cPanel Access Level:
    Root Administrator
    Twitter:
    Sure you can.
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  12. cPanelMichael

    cPanelMichael Technical Support Community Manager
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    45,214
    Likes Received:
    1,937
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Twitter:
    Hello,

    It's by design that backups aren't pruned in situations where a partial backup failure occurs. Could you address the issues on any of the accounts that are failing during the backup generation and then let us know if the issue continues?

    Thank you.
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
Loading...

Share This Page

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice