The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Problem with huge accounts backups

Discussion in 'Data Protection' started by Kent Brockman, May 27, 2015.

  1. Kent Brockman

    Kent Brockman Well-Known Member

    Joined:
    Jan 20, 2008
    Messages:
    1,130
    Likes Received:
    3
    Trophy Points:
    38
    Location:
    Buenos Aires, Argentina
    cPanel Access Level:
    Root Administrator
    Twitter:
    Hello buddies. I'm noticing this issue when cPanel backup script needs to transfer a backup to a remote destination like Amazon S3. When the account is using several Gigabytes of data, the backup zip file is randomly chunked to 1.2-2.2 GB in size.

    I see this happenning with accounts that allocate more than 10 GB of files, which is not a weird amount of data nowadays. It happens whether I use local or remote backups.

    May this be some kind of OS restriction? I'm using CentOS 6.6 in several VPS. May be a bug in backup script? what steps can I take to troubleshoot it?

    Thanks in advance
     
  2. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    30,854
    Likes Received:
    676
    Trophy Points:
    113
    cPanel Access Level:
    Root Administrator
    Hello,

    Are there any error messages in the backup logs within /usr/local/cpanel/logs/cpbackup/ when this happens? Are you able to extract the archive manually, and if so, do you notice any missing files?

    Thank you.
     
  3. Kent Brockman

    Kent Brockman Well-Known Member

    Joined:
    Jan 20, 2008
    Messages:
    1,130
    Likes Received:
    3
    Trophy Points:
    38
    Location:
    Buenos Aires, Argentina
    cPanel Access Level:
    Root Administrator
    Twitter:
    Hello Michael, the logs are not showing any errors. By example, an account weighing 18GB is resulting in a tar.gz file of barely 1.3 GB, and when I decompress that tar.gz, I can see there are mail and public_html folders clearly missing.

    And I'm using pigz. May it be due to a bug on it? should I try with classic gzip?

    Any idea? should I open a ticket?
    Thanks!
     
  4. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    30,854
    Likes Received:
    676
    Trophy Points:
    113
    cPanel Access Level:
    Root Administrator
    Is it possible that certain directories have been excluded in the /etc/cpbackup-exclude.conf file, or in the /home/username/cpbackup-exclude.conf file?

    Thank you.
     
  5. Kent Brockman

    Kent Brockman Well-Known Member

    Joined:
    Jan 20, 2008
    Messages:
    1,130
    Likes Received:
    3
    Trophy Points:
    38
    Location:
    Buenos Aires, Argentina
    cPanel Access Level:
    Root Administrator
    Twitter:
    Nope. No exclusions.
    Also, there is plenty of free disk space.
     
  6. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    30,854
    Likes Received:
    676
    Trophy Points:
    113
    cPanel Access Level:
    Root Administrator
    Could you open a support ticket using the link in my signature so we can take a closer look? You can post the ticket number here so we can update this thread with the outcome.

    Thank you.
     
  7. Kent Brockman

    Kent Brockman Well-Known Member

    Joined:
    Jan 20, 2008
    Messages:
    1,130
    Likes Received:
    3
    Trophy Points:
    38
    Location:
    Buenos Aires, Argentina
    cPanel Access Level:
    Root Administrator
    Twitter:
    Also, if I untar the backup file, it ends with a message:

    And reviewing the extracted files, looks like the compression have included some of the mail accounts and suddenly have been trunked, because there is no public_html nor tmp folders included... And this is happenning in all the huge accounts.

    I'll open a ticket and post its ID...
     
  8. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    30,854
    Likes Received:
    676
    Trophy Points:
    113
    cPanel Access Level:
    Root Administrator
    The "tar: Unexpected EOF in archive" message indicates archive corruption. It's likely something prevented the archive from generating successfully (e.g. lack of memory, lack of inodes, etc). Feel free to update this thread with the ticket number.

    Thank you.
     
  9. Kent Brockman

    Kent Brockman Well-Known Member

    Joined:
    Jan 20, 2008
    Messages:
    1,130
    Likes Received:
    3
    Trophy Points:
    38
    Location:
    Buenos Aires, Argentina
    cPanel Access Level:
    Root Administrator
    Twitter:
    There are hundred of GB of free disk space.
    RAM used: 1.5/8.0 GB
    inodes usage: <5%

    Anyway, the ticket ID is:
    6587589
     
  10. Kent Brockman

    Kent Brockman Well-Known Member

    Joined:
    Jan 20, 2008
    Messages:
    1,130
    Likes Received:
    3
    Trophy Points:
    38
    Location:
    Buenos Aires, Argentina
    cPanel Access Level:
    Root Administrator
    Twitter:
    Hello guys. The problem was caused by Process Tracking feature by CSF plugin, which monitors processes that take to long to finish, and it was set to just kill those processes. That lead to obtaining incomplete backup files. Now that I whitelisted the perl process, may now work as expected.
     
  11. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    30,854
    Likes Received:
    676
    Trophy Points:
    113
    cPanel Access Level:
    Root Administrator
Loading...

Share This Page